[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: analytics suite #1626

Merged
merged 48 commits into from
Jul 1, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
470956a
feature: logging middleware
densumesh Jun 18, 2024
c159f94
feature: log events to clickhouse
densumesh Jun 21, 2024
46629b1
feature: send clickhouse data in handler
densumesh Jun 21, 2024
f9317c9
feature: query vector in clickhouse
densumesh Jun 21, 2024
cff1dec
bugfix: fix async inserts, feature: add fulltext vectors
densumesh Jun 22, 2024
7a40d54
feaure: embed and store clusters in clickhouse
densumesh Jun 22, 2024
94b9806
cleanup: dont send vectors to clickhouse
densumesh Jun 22, 2024
610f56e
clenaup: clippy fixes
densumesh Jun 22, 2024
c2d9ddf
revert: add back self-hosting.md
densumesh Jun 22, 2024
4f51885
feature: access analytics from server routes
densumesh Jun 25, 2024
811e1ae
fmt: cargo fmt
densumesh Jun 26, 2024
9ade962
bugfix: fix redoc errors
densumesh Jun 26, 2024
c7ad13a
feature: clickhouse operator and clustering cronjob
densumesh Jun 26, 2024
84a76e2
bugfix: clickhouse operator
densumesh Jun 26, 2024
55b7f86
feature: log events to clickhouse
densumesh Jun 21, 2024
81367c0
feat: analytics site
drew-harris Jun 25, 2024
04e58d0
feature: env var for analytics
densumesh Jun 27, 2024
d512d40
feature: fix tokio error
densumesh Jun 27, 2024
3639ab9
feature: error silently if clickhouse insert errors
densumesh Jun 27, 2024
5eb8dfc
feature: move to CH for events
densumesh Jun 27, 2024
3bb4889
bugfix: fix clickhouse error
densumesh Jun 27, 2024
7667d19
ops: docker images and CI actions
cdxker Jun 27, 2024
98486b2
feature: events in clickhouse
densumesh Jun 27, 2024
87de69d
fix: add solid query devtools
drew-harris Jun 27, 2024
68788e5
fix: better canvas
drew-harris Jun 27, 2024
be55a1a
feat: showing queries in sidebar
drew-harris Jun 27, 2024
5c1a933
fix: eslint
drew-harris Jun 27, 2024
0dcb310
bugfix: change to new database name
densumesh Jun 27, 2024
1565805
feat: show head queries
drew-harris Jun 27, 2024
97c4608
feat: pagination hook
drew-harris Jun 27, 2024
1abaa7d
feat: low confidence queries
drew-harris Jun 27, 2024
641c8fe
cleanup: change search type to top score
drew-harris Jun 27, 2024
761fc54
feat: remove chunk action and rename bulk chunk upload fail
drew-harris Jun 28, 2024
e51d9c4
feat: log delete chunks success / failure in clickhouse
drew-harris Jun 28, 2024
a34307c
fix: change database name in create_event_query from default -> trieve
drew-harris Jun 28, 2024
8658bc9
cleanup: fix database name and change to chunk count
drew-harris Jun 28, 2024
5f36d6e
bugfix: fix grupdate event
densumesh Jun 28, 2024
871a9ec
feature: delete from clickhouse when dataset is deleted
densumesh Jun 28, 2024
db88c34
bugfix: replace string interp with binds for clickhouse delete
densumesh Jun 28, 2024
a46f7d7
make envs be evaluated at runtime
cdxker Jul 1, 2024
624d2ab
ops: updated Dockerfiles to compile clickhouse crate
cdxker Jul 1, 2024
9513aa9
bugfix: make dashbaord events work again
densumesh Jul 1, 2024
cd4081a
bugfix: change event_data to be a string
densumesh Jul 1, 2024
ab2f2b7
bugfix: make events look better on the UI
densumesh Jul 1, 2024
cf71396
security: remove the ability to auto link user accounts
densumesh Jul 1, 2024
9a4b858
feature: cleanup Dockerfiles
cdxker Jul 1, 2024
5acc2e5
ops: group worker docker image + CI action
cdxker Jul 1, 2024
4399e34
bugfix: make analytics compile
densumesh Jul 1, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
cleanup: fix database name and change to chunk count
  • Loading branch information
drew-harris authored and cdxker committed Jul 1, 2024
commit 8658bc93f2436b39bc2365104e385290820bf195
2 changes: 1 addition & 1 deletion server/src/data/models.rs
densumesh marked this conversation as resolved.
Show resolved Hide resolved
Original file line number Diff line number Diff line change
Expand Up @@ -1407,7 +1407,7 @@ pub enum EventType {
},
#[display(fmt = "bulk_chunks_deleted")]
BulkChunksDeleted {
chunk_ids: Vec<uuid::Uuid>,
message: String,
},
#[display(fmt = "dataset_delete_failed")]
DatasetDeleteFailed {
Expand Down
2 changes: 1 addition & 1 deletion server/src/operators/dataset_operator.rs
Original file line number Diff line number Diff line change
Expand Up @@ -311,7 +311,7 @@ pub async fn delete_chunks_in_dataset(
Event::from_details(
id,
EventType::BulkChunksDeleted {
chunk_ids: chunk_ids.clone(),
message: format!("Deleted {} chunks", chunk_ids.len()),
},
),
clickhouse_client.clone(),
Expand Down
2 changes: 1 addition & 1 deletion server/src/operators/event_operator.rs
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ pub async fn create_event_query(
.unwrap_or(false)
{
client
.query("INSERT INTO trieve.dataset_events (id, dataset_id, event_type, event_data, created_at) VALUES (?, ?, ?, ?, now())")
.query("INSERT INTO default.dataset_events (id, dataset_id, event_type, event_data, created_at) VALUES (?, ?, ?, ?, now())")
.bind(event.id)
.bind(event.dataset_id)
.bind(event.event_type)
Expand Down