Commit graph

630 commits

Author SHA1 Message Date
github-actions[bot]
123e96e701
Release HyperDX (beta) (#802)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Warren <5959690+wrn14897@users.noreply.github.com>
2025-05-07 15:38:06 -07:00
Warren
1df102cdaa
dx: add 'setup' script command (#803)
Since "prepare" is no longer supported in Yarn 2+, the new setup command should ensure that pre-commit is set up properly
2025-05-07 21:31:02 +00:00
Mike Shi
931d7387d9
fix: bugs with showing non otel spans (ex. clickhouse opentelemetry span logs) (#789)
<img width="1645" alt="image" src="https://github.com/user-attachments/assets/2f7eb93f-9648-4c98-8bfd-a2d0f65be9d5" />

fixing a few bugs that prevented us from properly rendering trace view for `system.opentelemetry_span_log`

fix HDX-1676

Co-authored-by: Warren <5959690+wrn14897@users.noreply.github.com>
2025-05-07 16:08:21 +00:00
Aaron Knudtson
1674ab8672
Move swagger to prod dependency (#801)
Noticed that images can't run because swagger was listed as a dev dependency
2025-05-07 16:05:15 +00:00
github-actions[bot]
cb52a48b5b
chore(release): bump HyperDX app/package versions (beta) (#771)
This PR was opened by the [Changesets release](https://github.com/changesets/action) GitHub action. When you're ready to do a release, you can merge this and the packages will be published to npm automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to v2, this PR will be updated.

⚠️⚠️⚠️⚠️⚠️⚠️

`v2` is currently in **pre mode** so this branch has prereleases rather than normal releases. If you want to exit prereleases, run `changeset pre exit` on `v2`.

⚠️⚠️⚠️⚠️⚠️⚠️

# Releases
## @hyperdx/common-utils@0.2.0-beta.4

### Minor Changes

-   79fe30f: Queries depending on numeric aggregates now use the type's default value (e.g. 0) instead of null when dealing with non-numeric data.

### Patch Changes

-   cfdd523: feat: clickhouse queries are by default conducted through the clickhouse library via POST request. localMode still uses GET for CORS purposes
-   92a4800: feat: move rrweb event fetching to the client instead of an api route
-   7f0b397: feat: queryChartConfig method + events chart ratio

## @hyperdx/api@2.0.0-beta.15

### Minor Changes

-   79fe30f: Queries depending on numeric aggregates now use the type's default value (e.g. 0) instead of null when dealing with non-numeric data.

### Patch Changes

-   9a9581b: Adds external API for alerts and dashboards
-   293a2af: Adds openapidoc annotations for spec generation and swagger route for development
-   92a4800: feat: move rrweb event fetching to the client instead of an api route
-   7f0b397: feat: queryChartConfig method + events chart ratio
-   b4b5f6b: style: remove unused routes/components + clickhouse utils (api)
-   Updated dependencies [79fe30f]
-   Updated dependencies [cfdd523]
-   Updated dependencies [92a4800]
-   Updated dependencies [7f0b397]
    -   @hyperdx/common-utils@0.2.0-beta.4

## @hyperdx/app@2.0.0-beta.15

### Patch Changes

-   7de8916: Removes trailing slash for connection urls
-   cfdd523: feat: clickhouse queries are by default conducted through the clickhouse library via POST request. localMode still uses GET for CORS purposes
-   6dc6989: feat: Automatically use last used source when loading search page
-   92a4800: feat: move rrweb event fetching to the client instead of an api route
-   7f0b397: feat: queryChartConfig method + events chart ratio
-   b4b5f6b: style: remove unused routes/components + clickhouse utils (api)
-   Updated dependencies [79fe30f]
-   Updated dependencies [cfdd523]
-   Updated dependencies [92a4800]
-   Updated dependencies [7f0b397]
    -   @hyperdx/common-utils@0.2.0-beta.4


Co-authored-by: Warren <5959690+wrn14897@users.noreply.github.com>
2025-05-07 05:34:27 +00:00
Warren
852913f04c
ci: update release workflow (to notify downstream) (#800) 2025-05-06 23:46:55 +00:00
Mike Shi
4b1f9af221
feat: denoise search results (#751)
![image](https://github.com/user-attachments/assets/85966fd0-3109-46a3-ab70-56ba06d1ac30)
2025-05-06 17:47:44 +00:00
Mike Huang
37c094948c
fix: wrap long query for sql input in search page (#777)
- add width limit to sql query input
- fix in search page and session page

https://github.com/user-attachments/assets/f4b0655e-20ad-417a-87cd-ae50f6f5d3e0

<img width="1255" alt="image" src="https://github.com/user-attachments/assets/51e9429a-569e-4a10-ac68-8eb2858d0b59" />


Ref: hdx-1655
2025-05-06 09:06:56 +00:00
Mike Shi
15bb9e6c7e
chore: remove unused dependencies (#791)
- removes redis from stack (using in memory rate limiter)
- deletes unused miner code (moved to browser-based pyodide module)
- fixes rate limit bug

fixes HDX-1248
2025-05-06 03:13:20 +00:00
Mike Shi
6dc6989fdc
feat: Save last source as default source on search page load (#790)
fixes HDX-1680
2025-05-05 16:31:12 +00:00
Dan Hable
5254a6f555
build: added OTEL smoke tests to CI (#785)
Added an another job the CI build definitions to run the smoke tests for the OTEL collector configuration.

Ref: HDX-1642
2025-05-01 16:45:32 +00:00
Ernest Iliiasov
51ffde3791
fix: Not all console.error shows up in session replay play bar annotations (#765) 2025-04-30 16:26:42 +00:00
Ernest Iliiasov
d77cb2d5bc
feat: Allow to add webhooks from Create Alert modal (#767)
![Screenshot 2025-04-19 at 11 34 19 AM](https://github.com/user-attachments/assets/9a3a87eb-9011-474c-ae8e-c26b13e17026)
2025-04-30 16:23:40 +00:00
Ernest Iliiasov
66eca9025e
fix: Better loading state for Client Sessions page (#783)
Address this issue:

> when I visit sessions page and select the source, the instruction shows up and I can see sessions once they are loaded. 

Improves loading state handling and checks for source type.
2025-04-30 16:20:10 +00:00
Ernest Iliiasov
94aa5f8e67
feat: Open span details panle in Service Health dashboard (#784) 2025-04-30 16:15:07 +00:00
Dan Hable
79fe30f503
fix: aggFn use default instead of null (#782)
Switched to the `-OrDefault` version of the float conversion when combined with the aggregate functions to prevent emitting null.

Ref: HDX-1379
2025-04-29 18:29:37 +00:00
Tom Alexander
293a2affc8
feat: Adds auto openapi doc generation + swagger UI for API (#779)
* Adds support for auto-openapi doc generation
* Adds a swagger route for local development
* Adds a script to manually generate the openapi doc (to be used later if we publish to our site, etc...)

Ref: HDX-1661
2025-04-29 17:54:34 +00:00
Tom Alexander
7de8916074
fix: Strip trailing slash for connections (#752) 2025-04-29 13:38:21 -04:00
Tom Alexander
9a9581b658
feat: Add dashboards and alerts external routes (#778)
* Adds routes and tests for alerts and dashboards
* Adds tests for v2 `/`

Ref: HDX-1649
Ref: HDX-1650
2025-04-29 17:09:32 +00:00
Aaron Knudtson
5b48f044a1
fix: remove authorization header from frontend (#781) 2025-04-28 11:57:29 +02:00
Aaron Knudtson
cfdd523516
feat: use clickhouse client lib by default for queries (#776)
Still uses the old fetch method on local mode

Ref: HDX-1630
Ref: HDX-1653
2025-04-25 19:08:56 +00:00
Mike Huang
8dc83c3d4e
enable float threshold for chart alert (#773)
- add new schema to support float threshold for chart alert
<img width="882" alt="image" src="https://github.com/user-attachments/assets/dd563bf2-9ae9-4c8f-ad63-731d8815518a" />

Tested alert:
<img width="1256" alt="image" src="https://github.com/user-attachments/assets/92683d01-ada4-48e7-bd2b-567aba949e4b" />



Ref: hdx-1640
2025-04-24 17:44:57 +00:00
Warren
14c2821be5
feat: introduce demo sessions (#775) 2025-04-23 21:44:32 +00:00
Warren
8dc0492c09
fix: handle the nullish value input (AutocompleteInput) (#774)
Ref: HDX-1639
2025-04-23 13:14:22 +00:00
Aaron Knudtson
92a48003a4
feat: move rrweb event stream to client and query through /api/clickhouse-proxy (#755) 2025-04-22 18:01:09 -04:00
Warren
b4b5f6ba9b
style: remove unused routes/components + clickhouse utils (api) (#772)
1. deprecate `metrics`, `logs` and `chart` routes
2. deprecate `logStreamTableVersion` in team model
3. cleanup api clickhouse index file
4. deprecate propertyTypeMappingModel + searchQueryParser on the api side
5. deprecate `SearchInput`, `MetricTagFilterInput` and `MetricTagValueSelect` components

Ref: HDX-1647

Cut off 15% of codes 🎉
2025-04-22 17:19:25 +00:00
Ernest Iliiasov
d1cd667f41
fix: Optimize live tail memory (#764) 2025-04-22 14:40:52 +00:00
Ernest Iliiasov
bbde4bc08e
fix: Fix the off-by-one error in the session player event list (#768) 2025-04-22 14:00:55 +00:00
Ernest Iliiasov
7693ff50be
feat: Add top-level filters for Kubernetes Dashboard (#766)
![Screenshot 2025-04-18 at 10 08 00 PM](https://github.com/user-attachments/assets/647091fd-7cd7-4590-a9cb-062ec35aa362)
2025-04-22 04:38:08 +00:00
Mike Huang
4acb8bcd9d
fix incorrect split for select query (#754)
- add new split function for brackets and quotes selection 
- should only affect SELECT section in search component
- add test

<img width="1236" alt="image" src="https://github.com/user-attachments/assets/569d569c-c52e-4f17-84be-0ec52175df0e" />


Ref: hdx-1587
2025-04-22 02:33:12 +00:00
Warren
7f0b397969
feat: queryChartConfig method + events chart ratio (#759)
Ref: HDX-1631

1. use temp centralized `queryChartConfig` to handle multi-series chart (metrics specifically)
2. move ratio computation logics (events chart) to the renderChartConfig
3. fix missing `seriesReturnType` prop in chartConfig in the checkAlert file
2025-04-21 22:52:55 +00:00
github-actions[bot]
4172743ee9
chore(release): bump HyperDX app/package versions (beta) (#743)
This PR was opened by the [Changesets release](https://github.com/changesets/action) GitHub action. When you're ready to do a release, you can merge this and the packages will be published to npm automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to v2, this PR will be updated.

⚠️⚠️⚠️⚠️⚠️⚠️

`v2` is currently in **pre mode** so this branch has prereleases rather than normal releases. If you want to exit prereleases, run `changeset pre exit` on `v2`.

⚠️⚠️⚠️⚠️⚠️⚠️

# Releases
## @hyperdx/common-utils@0.2.0-beta.3

### Patch Changes

-   092a292: fix: autocomplete for key-values complete for v2 lucene
-   2f626e1: fix: metric name filtering for some metadata
-   b16c8e1: feat: compute charts ratio
-   4865ce7: Fixes the histogram query to perform quantile calculation across all data points

## @hyperdx/api@2.0.0-beta.14

### Patch Changes

-   e5dfefb: Added test cases for the webhook and source routes.
-   f5e9a07: chore: bump node version to v22
-   Updated dependencies [092a292]
-   Updated dependencies [2f626e1]
-   Updated dependencies [b16c8e1]
-   Updated dependencies [4865ce7]
    -   @hyperdx/common-utils@0.2.0-beta.3

## @hyperdx/app@2.0.0-beta.14

### Patch Changes

-   56e39dc: 36c3edc fix: remove several source change forms throughout the log drawer
-   092a292: fix: autocomplete for key-values complete for v2 lucene
-   2f626e1: fix: metric name filtering for some metadata
-   f5e9a07: chore: bump node version to v22
-   b16c8e1: feat: compute charts ratio
-   08009ac: feat: add saved filters for searches
-   db761ba: fix: remove originalWhere tag from view. not used anyways
-   8c95b9e: Add search history
-   Updated dependencies [092a292]
-   Updated dependencies [2f626e1]
-   Updated dependencies [b16c8e1]
-   Updated dependencies [4865ce7]
    -   @hyperdx/common-utils@0.2.0-beta.3


Co-authored-by: Warren <5959690+wrn14897@users.noreply.github.com>
2025-04-21 21:13:20 +00:00
Dan Hable
e5dfefb746
chore: adding test cases for additional routes (#762)
Ref: HDX-1619
2025-04-21 20:07:12 +00:00
Dan Hable
1c54b59939
feat: Handle JSON-like structured logs better (#763)
Updates the OTEL pipeline to handle structured logs better. If the body content is an OTEL map, it will merge the body map into the log attributes map. If the body is a JSON object, it will parse the JSON string into an OTEL map, then merge the fields into the log attributes map.

Replacing the Body field doesn't work since the Clickhouse exporter schema defines Body as string, so any parsed out object ends up turning back into a string. At least as log resources, it's a lighter weight means of grouping and filtering in the UI.

Ref: HDX-1453
2025-04-21 18:11:00 +00:00
Ernest Iliiasov
b38668aa51
feat: Open event details side panel from K8s Pod Events (#770) 2025-04-21 17:47:03 +00:00
Ernest Iliiasov
6d087a19d6
feat: Dashboard auto-refresh (#769)
![Screenshot 2025-04-19 at 7 19 13 PM](https://github.com/user-attachments/assets/5c2707aa-1667-4935-ac9d-0e5ea77a4b31)
2025-04-21 17:39:06 +00:00
Dan Hable
19431d3fe9
Moving HDX-1514 to open source repo (#761)
1. Moves the HDX-1514 log inference change into the OSS repo.
2. Bumps the OTEL collector version to match
2025-04-18 19:09:14 +00:00
Mike Shi
e0192e0602
feat: Add basic browser/wasm-based event patterns table (#750)
closes HDX-1609

<img width="2480" alt="image" src="https://github.com/user-attachments/assets/9e668b1c-1fa4-4e69-9306-d25d11e8444b" />

adds pyodide to the project
2025-04-18 16:57:11 +00:00
Aaron Knudtson
2f626e1f30
fix: add optional metric name filtering to useAllFields (#757)
Fixes: HDX-1600
2025-04-18 01:58:01 +00:00
Mike Huang
8c95b9e1ba
feat: add search history for search page (#749)
- save search history for search page
- record number limit to 10
- add search history relate function
- support both sql and lucene search
- test


https://github.com/user-attachments/assets/67bbc4ce-999d-494d-9fa4-1f085c2fbf8d




ref: hdx-1565
2025-04-17 20:19:16 +00:00
Warren
b16c8e1429
feat: compute charts ratio (#756)
Ref: HDX-1607

Support ratio for both events and metrics charts

<img width="1504" alt="image" src="https://github.com/user-attachments/assets/e563c609-b48f-4217-bf6a-b11c5e075435" />
2025-04-17 04:50:19 +00:00
Warren
35a1c31658
feat: add demo metric source (#758) 2025-04-16 23:58:18 +00:00
Warren
39403429a0
fix: setup date range boundary for MetricNameSelect comp (#753)
ref: HDX-1599
2025-04-16 22:04:15 +00:00
Warren
f5e9a07ef1
chore: bump node version to v22 (#744) 2025-04-15 16:56:56 +00:00
Dan Hable
4865ce7a62
fix: fix histogram metric query (#737)
Fix for the histogram query based on the late night session at KubeCon.

Ref: HDX-1572
2025-04-14 22:04:13 +00:00
Aaron Knudtson
08009ac3b3
feat: pinned search filters (#746) 2025-04-14 12:58:19 -04:00
Mike Huang
0d37943624
fix: missing sql config for sesstion page (#707)
When search surrounding context in session page,
missing query cause component failed to build config,
now will build config from source if query is missing.

<img width="1488" alt="image" src="https://github.com/user-attachments/assets/6cf6ef79-97d8-4e01-8c41-b2f6a81c5e7c" />


Ref: hdx-1497
2025-04-11 18:55:14 +00:00
Tom Alexander
3a524e2e37
feat: Resizable span name column in timeline chart (#742)
Utilizes resizable hook so that span names can be resized in timeline waterfall view.

[screen-capture (7).webm](https://github.com/user-attachments/assets/5b56e7fd-839d-434d-80f6-08fd3503a08a)

Ref: HDX-1534
2025-04-11 18:49:57 +00:00
Tom Alexander
09c7b163e4
fix: Clear search filters when data source is changed (#747) 2025-04-09 16:17:30 -04:00
Aaron Knudtson
092a292b60
fix: autocomplete for lucene column values (#720)
![image](https://github.com/user-attachments/assets/14048d5c-a88b-46ef-b15b-1412791923de)

Added autocomplete for potential search values for lucene where clauses.
Added testing for useAutoCompleteOptions and useGetKeyValues.

Ref: HDX-1509
2025-04-08 21:36:42 +00:00