Infrastructure Considerations for Generative AI