My hobby spending is blowing my budget, and I don’t want to quit what I love

I’ve always loved collecting vintage vinyl records, and lately it’s been getting a bit out of hand financially. I set a monthly budget of $100 for new finds, but some months I end up spending closer to $200 or more because of rare deals or auctions. I’ve tried tracking every purchase and cutting back on eating out to compensate, but it feels like I’m just shifting money around instead of actually saving. My rent and bills are pretty steady, and I have a small emergency fund, but I want to avoid dipping into that. Honestly, giving up vinyl altogether isn’t an option since it’s my main stress relief. I’m wondering if anyone else has balanced a pricey hobby with everyday expenses without feeling guilty or broke? Have you found any budgeting tricks that work for irregular hobby expenses? Or ways to still enjoy collecting without going overboard?