Community, noun: “A feeling of fellowship with others, as a result of sharing common attributes, interests, and goals”
The fun picture you see here was taken at the first lecture of the First international Presto summit in Israel last month.
The atmosphere in the room during the various presentations was unique. It’s as if you could physically feel the brainpower of 250 engineers fascinated by technology in one room.
We would like to share with you a bit of the content that was discussed during the conference. Enjoy the read and the videos!
The Presto founders presented in their talk the following topics:
David Krakov, co-founder and CTO at Varada explained how Varada is an example of how Presto can be leveraged to create a new innovative technology that allows interactive analytics on top of a data lakes extracted sets, or in other words Presto for apps.
David presented the three axes of innovation that the Varada team created, to achieve an indexed big data on a distributed platform:
All those queries come through a unified front end for data discovery, transformation, and query: the Quix IDE. Quix is simultaneously: A notebook manager for users to write and share executable notes
As a Presto centric company Wix has developed few more exciting enhancements:
Ironsource is the ad network of choice for the gaming industry. Supplying solutions for application developers, customer engagement solutions and Ad monetization. Ironsource collects terabytes of events on a daily basis.
In his talk, Or Koren, head of the data team at Ironsource, shared their journey from terabyte scale to petabyte scale. In his talk Or showed how their entire interactive analytics platform was rebuilt to be based on Presto, and the huge savings they got from it including new business insights coming from their data science teams and the data analyst team.
The before and after slides that Or presented in a very clear way the reduction in cost and the increase in efficiency that the use of Presto brought to Ironsource.
A charismatic presenter, Alexey Finkelstein from Salesforce Datorama had the room rolling with laughter more than once, and on a topic of no laughter: managing mutable data with Presto. Datorama provides a marketing intelligence platform. It has 30,000 customers, who can interactively interact with 1.5PB of data available for interactive queries.
Datorama provides for that a “data lake as a service”, called a DatoLake. Files on data lakes by their nature are not transactionally updatable on a row level, but the users of Datorama require the ability to delete/update specific rows in a transactional manner.
To solve this Datorma has embarked on a journey. Based on partitioning the data by a version number (such as 20190101_009), and rebuilding a partition based on updates. There were 3 attempts to the journey and learning on each step:
Roman Zeyde is Varada’s Presto architect. Roman has a unique algorithmic background being a Talpiot graduate and an ex-Googler.
Roman’s talk discussed a new approach to make Joins work faster. Varada will contribute Roman’s work on dynamic filtering back to the community. Stay tuned 🙂
The talk went over the following major topics:
The event finished by an hour-long Q&A session led by Demi Ben-Ari, VP R&S at Panorays and co-founder of Big Things, an Israeli Meetup group having 5000 people listed, all fans of Big data technologies.
See you all in the Second international Presto Conference in Tel Aviv!
Read the original post.