The real v2 - new database and new data model + gRPC #40
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
We are now using the proper cmd, internal, pkg structure. The fucntions and information flow within the program will still need to be overhauled.
Redesigned to have byte slices/arrays instead of strings for almost all relevant fields
- Might have to fix some naming conventons - This will also greatly benefit from general type clean up - benchmarking incoming
Sqlite is still a complete bottleneck, despite adding batched block insertions and dropping indexes while writing initially. Only 50% speed improvements up to now
write is not the bottleneck at all, it's pulling blocks
- Massive speed ups in initial sync - We need to adjust apis and remove legacy code
Working endpoints:
- GetInfo
- GetBestBlockHeight
- GetBlockHashByHeight
- TweaksArray ("unpruned" index)
- TweaksIndexArray (cut-through)
- Streaming Endpoints (only tweak data is included)
Todos:
- Make dust query for tweaks and utxos
- Refactor v1 endpoint to use DB interface
- Remove core/, dblevel/
|
blindbit-oracle communication with bitcoin node now requires rest to be enabled in bitcoin.conf blindbit.toml changes: validate gRPC endpoint using grpcurl: |
macgyver13
reviewed
Aug 21, 2025
| # bitcoin core rest endpoint | ||
| # note: requires bitcoin core PR #32540 (already merged to master but in a release yet) | ||
| # default: "" | ||
| core_rest_endpoint = "http://127.0.01:38332" |
This comment was marked as resolved.
This comment was marked as resolved.
Sorry, something went wrong.
This comment was marked as resolved.
This comment was marked as resolved.
setavenger
force-pushed
the
db-rpc-rest-overhaul
branch
from
8262ddc to
990db64
Compare
Should be fixed now |
macgyver13
reviewed
Aug 21, 2025
| "flag" | ||
| "fmt" | ||
| "path" | ||
| "runtime" |
|
This patch seems to address the outpoint index issue causing duplicate tweaks for a block |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Introducing a fully concurrent syncing process. Took some inspiration in libbitcoin's append only philosophy. gRPC reduces bandwidth and grPC streaming shows great performance increases with regards to pulling data as a client.
Pebble is used as key value store. Data model will be explained later
Bugs: