Skip to content

Conversation

@faltiska
Copy link
Contributor

@faltiska faltiska commented Jul 12, 2025

Changes:

  • Simple PSR test written in Locust.
  • Fixed unit tests for Windows.
  • Control the log level from env vars.
  • Run Uvicorn with multiple workers.

The PSR simulates users that execute the following scenario in a loop:

  • call the OpenAI API to convert text to speech
  • "play" the generated audio file (it doesn't play it, it just waits as long as playback would take)

faltiska added 6 commits July 12, 2025 10:00
CPU image 5.6Gb -> 4.9Gb
GPU image 14.8Gb -> 9.9Gb

Saved 4GBby using the cuda base image instead of cudnn-runtime. Saved 700MB by deleting the UV cache.

Improved the speed of rebuilding the image by merging the RUN commands into one.
@faltiska
Copy link
Contributor Author

faltiska commented Aug 3, 2025

I think the PSR will be useful, can you have a look at the PR, please?

@remsky

@faltiska faltiska closed this Sep 22, 2025
@faltiska
Copy link
Contributor Author

No response from the author.

@faltiska faltiska deleted the psr_test branch September 22, 2025 08:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant