Big Data Indexing Dramatically Accelerates Athena Query Performance
7 min read

Big Data Indexing Dramatically Accelerates Athena Query Performance

AWS Athena is a critical building block in any modern data lake architecture. As an AWS native implementation of Presto, Athena offers both the Presto query engine's versatility and tight integration with other AWS services. Athena lets data engineering teams create direct access to their AWS data sources such as S3, feed data into other AWS services, as well as share and control ad-hoc access...
David Krakov
David Krakov
November 23 2020
Filters
All Big Data Indexing Data Lake Data Virtualization Observability Presto Query Acceleration News
The New Stack: Data Virtualization in the Context of the Data Mesh
2 min read
The New Stack: Data Virtualization in the Context of the Data Mesh
To read the full article by Lawrence Hecht on TheNew Stack, click here. According to Hecth, the data mesh concept continues to pick up momentum as an approach where domains-oriented teams own “data products” and have a self-serve data infrastructure platform that both delivers the data product to consumers and allows the data to be analyzed/consumed. A data fabric and a data mesh bo...
Shira Sarid
Shira Sarid
February 21 2021
Varada Seamlessly & Dramatically Accelerates Trino Queries
3 min read
Varada Seamlessly & Dramatically Accelerates Trino Queries
To read the full press release on BusinessWire, click here. New Varada feature brings query acceleration technology directly to existing Trino clusters, via a seamless connector deployment. TEL AVIV, Israel--Varada, a data lake query acceleration innovator, today made available a new feature enabling data teams to accelerate by 10x-100x queries running on Trino clu...
Shira Sarid
Shira Sarid
February 11 2021
VentureBeat: Varada open-sources Workload Analyzer for PrestoDB and Trino
2 min read
VentureBeat: Varada open-sources Workload Analyzer for PrestoDB and Trino
To read the full article by Michael Vizard on VentureBeat, click here. Varada is trying to help increase the adoption of variants of an open source distributed SQL query engine for big data by making a Workload Analyzer it developed available under an open source license on Github. Workload Analyzer for Presto is compatible with both PrestoDB and Trino (forme...
Shira Sarid
Shira Sarid
February 9 2021
Varada Open-Sources Its Workload Analyzer to Help Data Teams Optimize Data Lake Queries
4 min read
Varada Open-Sources Its Workload Analyzer to Help Data Teams Optimize Data Lake Queries
To read the full press release on BusinessWire, click here. Workload Analyzer gives data engineers holistic visibility into performance of Presto® clusters, enabling resource optimization and improved service to business-wide users of Big Data analytics TEL AVIV, Israel -- Varada, the data lake query acceleration innovator, today announced that it has open-sourced its Worklo...
Shira Sarid
Shira Sarid
February 3 2021
Data Lake Solutions Foster an Ocean of Analytics Use Cases
4 min read
Data Lake Solutions Foster an Ocean of Analytics Use Cases
Data lakes are built using a versatile set of technologies that can be used to implement a wide range of solutions, including for raw data collection, flexible data access for users, and building fast and efficient data warehouses. The two primary types of data lake solutions are as a data staging ground, to transform raw data into a format that’s usable for data analysis and reporting; an...
Ori Reshef
Ori Reshef
January 31 2021
An Analytics Workload is a Critical Data Management Tool
6 min read
An Analytics Workload is a Critical Data Management Tool
This blog post was originally published in DevOps.com. From an organizational perspective, an analytics workload is a way to gain a data-driven business advantage. Analytics workloads can serve a primary objective that translates to an actionable business impact (such as analyzing A/B testing results, understanding user retention or finding anomalies in a flow, for instance) or can ...
David Krakov
David Krakov
January 27 2021
Data Lake vs. Data Warehouse: How Data and Schema Interact
3 min read
Data Lake vs. Data Warehouse: How Data and Schema Interact
Coming from years of experience building enterprise data warehouses, a data lake architecture can be confusing. Some parts appear to be similar - both have data storage systems, query engines, and user management. Other parts are similar but play different roles. At the heart of how the two are different is how both data warehouses and data lakes use their data catalogs. In a data warehous...
Ori Reshef
Ori Reshef
January 14 2021
PrestoSQL is now trino
2 min read
PrestoSQL is now trino
When we started Varada, we faced a strategic decision. Among several data lake query engines that were available, we chose Presto as the SQL query engines on which we built Varada. Born in Facebook, Presto was gaining popularity in the developer community as a groundbreaking query engine that finally enables organizations to query their entire data lake and connect to as many data sources a...
Eran Vanounou
Eran Vanounou
January 6 2021
The Power of Big Data Indexing for Analytics
3 min read
The Power of Big Data Indexing for Analytics
A standard approach for speeding up access to data in a database is indexing fields that are commonly used in query predicates. The most common indexing techniques were developed for transaction processing databases. For example, by indexing on a customer identifier, a database management system can efficiently find just the records associated with a customer. Instead of scanning the entire da...
David Krakov
David Krakov
December 30 2020
Choosing Smart: Micro-Partitioning vs. Indexing
7 min read
Choosing Smart: Micro-Partitioning vs. Indexing
How to choose the right solution for your big data analytics engine The most important decision in order to get reasonable performance out of your analytics database is to choose how data is stored and accessed. There are two approaches, both specifically optimized for efficient, high performance analytics. Micro-partitioning uses the values of a single column to divide subsets of each tabl...
David Krakov
David Krakov
December 20 2020
TechTarget: Varada accelerates data virtualization with Presto
1 min read
TechTarget: Varada accelerates data virtualization with Presto
To read the full article by Sean Michael Kerner on SearchDataManagement, click here. Varada announced today the general availability of its data platform, bringing data virtualization and data lake query acceleration capabilities to AWS. According to Kerner, "The promise of data virtualization is that users don't have to copy data to a single repository in order to analyze it. ...
Shira Sarid
Shira Sarid
December 10 2020
ZDNet: Varada and Firebolt launch cloud analytics query platforms
2 min read
ZDNet: Varada and Firebolt launch cloud analytics query platforms
To read the full article by Andrew Burst on ZDNet, click here. In the hot and ever-converging worlds of data lake and data warehouse platforms, two new Israelis startups emerge. Varada delivers data virtualization using an index-accelerated implementation of Presto, while Firebolt uses proprietary technology to build a high-performance data warehouse. Founded by ex-XtremIO (acqu...
Shira Sarid
Shira Sarid
December 9 2020
We use cookies to improve your experience. To learn more, please see our Privacy Policy
Accept