2: Kubernetes, arrays on Elasticsearch, and security breaks the UI

Video

• Presto Event: Presto for any company size (889s)
• Concept of the week: Presto on Kubernetes (1699s)
• PR of the week: PR 2441 Add array support using the _meta mapping in Elasticsearch (2484s)
• Question of the week: Why does my Presto UI say web interface disabled? (3306s)

Audio

This week we had a bit of a technical issue between zoom and OBS so there was some editing done to remove a portion of the broadcast which mainly cuts out us covering the releases. We circle back and give a small summary but unfortunately lost the majority of that part of the conversation.

In this week’s concept, we cover a general overview of kubernetes and how kubernetes is used when deploying and scaling up . We also dive into how this is being used at our guest Cory Darby’s company, BlueCat.

In this week’s pull request covers a pull request https://github.com/trinodb/trino/pull/2462 which closes ticket https://github.com/trinodb/trino/issues/2441. This was actually a PR Brian submitted some months ago. He dives into a bit about Elasticsearch mappings and how Elasticsearch models their data. He then covers how this motivated the pull request addressing the need for explicit mappings of which Elasticsearch fields are array types vs scalar.

In this week’s question, we answer, “Why does the web ui say “disabled”?” This typically comes from a security setup issue and there’s another similar issue when you are using a proxy that we cover as a bonus.

Release Notes discussed: https://trino.io/docs/current/release/release-342.html https://trino.io/docs/current/release/release-343.html

Manfred’s Training - SQL at any scale https://www.simpligility.com/2020/10/join-me-for-presto-first-steps/ <https://learning.oreilly.com/live-training/courses/presto-first-steps /0636920462859/>

Blogs

https://postgresconf.org/conferences/postgres-webinar-series/program/proposals/live-demo-creating-a-single-point-of-access-to-multiple-postgres-servers-using-starburst-presto

https://postgresconf.org/conferences/postgres-webinar-series/program/proposals/live-demo-unlock-data-in-postgres-servers-to-query-it-with-other-data-sources-like-hive-kafka-other-dbmss-and-more

https://medium.com/@joshua_robinson/presto-and-fast-object-putting-backups-to-use-for-devops-and-machine-learning-s3-46876eef4ffa

Upcoming events

• https://www.meetup.com/BigDataATL/events/273435961/
• https://edw2020chicago.dataversity.net/
• https://techtalksummits.com/event/virtual-commercial-it-portland-or-2/
• https://techtalksummits.com/event/virtual-commercial-it-minneapolis-mn-2/
• https://techtalksummits.com/event/virtual-commercial-it-jacksonville-fl/
• https://www.evanta.com/cdo/san-francisco/2020-san-francisco-cdo-virtual-executive-summit
• https://techtalksummits.com/event/virtual-commercial-it-detroit-mi/
• https://www.evanta.com/cdo/atlanta/2020-atlanta-cdo-virtual-executive-summit
• https://techtalksummits.com/event/virtual-commercial-it-providence-ri/
• https://techtalksummits.com/event/virtual-commercial-it-denver-co/
• https://www.evanta.com/cdo/boston/2020-boston-cdo-virtual-executive-summit

Latest training from David, Dain, and Martin: https://trino.io/blog/2020/07/15/training-advanced-sql.html https://trino.io/blog/2020/07/30/training-query-tuning.html https://trino.io/blog/2020/08/13/training-security.html https://trino.io/blog/2020/08/27/training-performance.html

Presto Summit Series - Real world usage https://trino.io/blog/2020/05/15/state-of-presto.html https://trino.io/blog/2020/06/16/presto-summit-zuora.html https://trino.io/blog/2020/07/06/presto-summit-arm-td.html https://trino.io/blog/2020/07/22/presto-summit-pinterest.html

Recent Podcasts: https://www.contributor.fyi/presto https://www.dataengineeringpodcast.com/presto-distributed-sql-episode-149/

If you want to learn more about Presto yourself, you should check out the O’Reilly Trino Definitive guide. You can download the free PDF or buy the book online.

Music for the show is from the Megaman 6 Game Play album by Krzysztof Słowikowski.