PaxCode BlogArchitecture, data and AI in production: Athena over hundreds of terabytes, LLM pipelines over transcripts, decisions and trade-offs.https://paxcode.it/enHundreds of terabytes in Athena: partitions by the hour, and queries that do lesshttps://paxcode.it/blog/athena-hourly-partitions/https://paxcode.it/blog/athena-hourly-partitions/Alerting queries over hundreds of terabytes of Parquet on S3 hit Athena’s 240-minute limit and were cancelled. Hourly partitions, file metadata moved out of every row, and ranges that split on failure brought them to about 30 minutes.Thu, 15 Oct 2026 00:00:00 GMTDataAWSAthena