delvingbitcoin

Combined summary - Mempool Based Fee Estimation on Bitcoin Core

Combined summary - Mempool Based Fee Estimation on Bitcoin Core

The discourse on blockchain transaction fee estimation addresses the challenges in accurately determining fee rates, especially during network congestion.

It highlights that inaccuracies in fee rate estimates often occur when the time to discover a new block exceeds 10 minutes. Using the 50th percentile as a benchmark for estimating fees has been shown to be effective, though there are risks of subsequent higher-fee transactions displacing earlier ones in the mempool. To improve understanding and accuracy of fee estimations, a revised methodology incorporating both linear and logarithmic scales has been introduced, aiming to inform users about potential overpayments.

The discussion also explores the Replace-By-Fee (RBF) mechanism, which balances economic benefits with the convenience of not adjusting fees post-submission. A more nuanced fee estimation format, backed by comprehensive datasets and visual aids accessible via Colab and GitHub links, promises improved accuracy. Concerns are raised about current methods' vulnerability to manipulation tactics similar to those used in selfish mining. Solutions include adopting a mempool-based estimation method to reduce overestimation risks and provide verbose options for better decision-making on fee adjustments.

Miner strategies that might artificially influence fee rates through mempool manipulation are scrutinized, emphasizing the need for algorithmic adjustments in fee estimation processes. The objective is to avoid aggressive overbidding or overly conservative underbidding. Integrating confirmed and mempool-based estimates, alongside proactive network stability measures during protocol updates, is suggested to enhance estimation accuracy. Additional insights are provided through a linked spreadsheet detailing the performance of proposed solutions.

The conversation acknowledges the intricacies within the Bitcoin network, including the displacement of transactions from the mempool. The integration of direct blockchain data into estimation processes is recommended for real-time adjustments reflecting current network conditions. In cases of significant discrepancies, reverting to established methods like the CBlockPolicyEstimator is advised. The approach of utilizing mempool and block information for estimation could outperform existing strategies, despite potential stability issues due to the dynamic nature of block formation.

Kalle Alm's presentation at Scaling Bitcoin 2017 offers insights into optimizing fee estimation through mempool state analysis, advocating for a balanced use of RBF and combining confirmed and real-time mempool estimates. Alm's work, accessible through slides, a transcript, and a video, also discusses the non-financial implications of RBF, such as privacy concerns. Bitcoin Core's exploration of mempool-based fee estimation is highlighted, noting its potential for generating accurate fee rates despite challenges related to discrepancies between nodes' mempools and technical hurdles in building block templates efficiently. This ongoing research aims to refine mempool-based fee estimation methods, supported by contributions from various developers.

Discussion History

0
ismaelsadeeq Original Post
March 21, 2024 16:27 UTC
1
March 21, 2024 17:33 UTC
2
March 21, 2024 20:55 UTC
3
March 22, 2024 11:38 UTC
4
March 22, 2024 11:40 UTC
5
March 22, 2024 23:41 UTC
6
March 25, 2024 08:36 UTC
7
April 1, 2024 20:35 UTC
8
April 1, 2024 21:19 UTC
9
April 2, 2024 00:43 UTC
10
April 2, 2024 14:34 UTC