Propr Hotfix: Resolving BTC Bottleneck
Summary
Propr announces an urgent hotfix to stabilize infrastructure after unprecedented app usage. The team is resolving a BTC order and position bottleneck that pushed processing into a single worker thread causing >1s per event and delays >30s. They are chunking positions and updating throttling to restore order matching and overall system performance.
The team is working around the clock to stabilize the infrastructure. We are reaching all time highs in app usage.
The technical issue we are hotfixing:
BTC is bottlenecking all other position and order matching we have several thousand BTC orders and positions and they are being pushed into one worker thread taking >1s to resolve which is bottlenecking processing other assets and is consistently taking >30s to resolve from the worker. The throttling system we had setup was on a 30s basis which was sufficient headroom at the time but not anymore, we are chunking positions and order matching to reduce the per event time.
The timing is unfortunate but we had to bump the infrastructure as we reached much higher than expected numbers on the competition.
Back very soon
