Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
P
pqlog
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Container Registry
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
smol
pqlog
Commits
905cfc4d
Commit
905cfc4d
authored
1 year ago
by
ale
Browse files
Options
Downloads
Patches
Plain Diff
Add links that were missing
parent
05afde35
No related branches found
Branches containing commit
No related tags found
Tags containing commit
No related merge requests found
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
README.md
+8
-6
8 additions, 6 deletions
README.md
with
8 additions
and
6 deletions
README.md
+
8
−
6
View file @
905cfc4d
...
...
@@ -74,10 +74,11 @@ supports structured schemas, can have trouble reconciling different
STRUCTs across different Parquet files. But it's a TODO to get rid of
this limitation.
The flattened records are then written to
[
Parquet
](
)
files, which are
rotated periodically (and when they reach a certain size). These files
can be stored remotely, although the current implementation only
supports local filesystem.
The flattened records are then written to
[
Parquet
](
https://parquet.apache.org/
)
files, which are rotated
periodically (and when they reach a certain size). These files can be
stored remotely, although the current implementation only supports
local filesystem.
The ingestion API endpoint is at
*/ingest*
, and it expects a POST
request with a ND-JSON request body: newline-delimited JSON-encoded
...
...
@@ -109,8 +110,9 @@ problematic field will be dropped from the schema.
### Querying
The query engine is
[
DuckDB
](
https://duckdb.org
)
, which can just
[
read
the Parquet files, even remotely
](
)
and run fast analytical queries on
them.
the Parquet files, even
remotely
](
https://duckdb.org/docs/data/parquet/overview
)
and run fast
analytical queries on them.
One thing of note is that, in the current implementation, it is only
possible to query fully written Parquet files. The implication is that
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment