Hey there! 👋
I've been contemplating building a solution leveraging the stable-diffusion model. I've come across several intriguing serverless GPU providers like
replicate.com,
banana.dev, and the like.
A friend pointed out, though, that these might run a bit slow. Plus, I made an interesting discovery while comparing costs. If you take the Nvidia T4 GPU replicate pricing ($0.033 per minute), AWS actually comes out about 3x cheaper for an Nvidia T4 GPU on-demand instance ($0.0087 per minute) and even 10x cheaper when you factor in EC2 spot instances.
So I'm thinking, wouldn't it make more sense to just use my own AWS GPU?
Do you know if there's a tool or something that might make this process easier?
Any tips or advice you can share? 🤔