Skip to content

[ServiceBus] aio AutoLockRenewer never prunes completed futures from _futures, leaking memory over a long-running consumer #48366

Description

@SirPangolin
  • Package Name: azure-servicebus
  • Package Version: 7.14.3
  • Operating System: Windows 11 Pro
  • Python Version: 3.13.5

Describe the bug
azure.servicebus.aio.AutoLockRenewer grows its internal _futures list by one entry on every register(...) and does not release those entries as the corresponding messages are settled - the list is only drained when the renewer is closed. A long-running consumer using the documented one-renewer-per-app pattern therefore accumulates one entry per message processed for the whole lifetime of the renewer: unbounded memory growth, reclaimed only on close().

This is the pattern the docs recommend (one long-lived renewer, register each message in the receive loop), so idiomatic usage hits it:

lock_renewal = AutoLockRenewer()
async with servicebus_receiver:
    async for message in servicebus_receiver:
        lock_renewal.register(servicebus_receiver, message, max_lock_renewal_duration=60)
        await process_message(message)
        await servicebus_receiver.complete_message(message)   # renewal completes here...
        # ...but its Future stays in lock_renewal._futures forever

To Reproduce

  1. Create a single long-lived AutoLockRenewer().
  2. Receive from a queue holding a few hundred messages; for each message, register(receiver, msg, ...) then settle it immediately with complete_message(msg) (so no renewal stays active).
  3. Print len(renewer._futures) periodically.
  4. Observe it climb to the all-time processed count and never shrink, even though every registered renewal has already completed; process RSS grows in lockstep. Only await renewer.close() releases them.

Expected behavior
A completed renewal's Future should be dropped from _futures when it finishes, so the list stays bounded by the number of active (unsettled) renewals rather than the process's all-time message count. In the repro above len(_futures) should hover near 0 (each message settles immediately), not grow to processed.

Screenshots
Not applicable

Additional context
The growth is proportional to the total number of messages handled over the process's uptime, not to how many renewals are active at once - the accumulated entries are only released when the renewer itself is closed, so a single app-lifetime renewer (the documented pattern) that stays open until shutdown holds them for the whole run. Higher throughput or longer uptime makes it more pronounced; a short-lived script that closes the renewer promptly won't notice.

Metadata

Metadata

Assignees

No one assigned

    Labels

    ClientThis issue points to a problem in the data-plane of the library.Service AttentionWorkflow: This issue is responsible by Azure service team.Service Buscustomer-reportedIssues that are reported by GitHub users external to the Azure organization.needs-team-attentionWorkflow: This issue needs attention from Azure service team or SDK teamquestionThe issue doesn't require a change to the product in order to be resolved. Most issues start as that

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions