Skip to content

Compaction concurrency is not respected for the same user #7298

@friedrichg

Description

@friedrichg

Describe the bug
When configuring concurrency to 1. compactors will run more than one compaction per compactor for the same user at the same time ignoring the concurrency configuration.
For example: 24h and 12h compaction at the same time.

This is surprising and can cause extra need of space in disks that is almost never used.

To Reproduce

  • Configure compactor concurrency to 1 (Default)
  • Use 2h,12h,24h blocks
  • Put 6x2h blocks and 2x12 blocks in the bucket
  • Watch the logs run compaction for both compaction levels at the same time

Expected behavior
it should only do one compaction at the time if concurrency is set to 1.
There should be an integration test for this

Environment:
ALL

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions