Background & What’s New As you may know, Trino pushes down information about the query into its data source connectors at the planning stage. This information allows the connector to return more precise data to Trino and potentially spare data fetching, data transfer over the network, and data processing and filtering by Trino. All of these directly affect the query execution time and t...

You can’t discuss game-changing improvements in Enterprise Data Management without discussing its evolution; each re-imagined paradigm, strategy, or technology represents a response to real-world challenges that may not have existed just a few years ago. Whether to improve on efficiency, accuracy, cost, or to reduce frustration among the data team, no new approach appears without specific trig...

Let’s begin this discussion with a prediction: By 2025, those of us who live in the ever-churning world of data aggregation, transportation, ETL, storage, BI, and accessibility will look at Data Mesh much as we look at cloud computing today: a strategy that simultaneously shrunk overhead (time and money), reduced grunt work (maintenance, upgrades, backups), and provided end-user abilities that...

Presto is an open source distributed SQL query engine for running interactive analytic queries against data sources of all sizes ranging from gigabytes to petabytes. It was designed to be highly adaptive, flexible, and extensible. It also can support a large variety of different use cases with diverse characteristics. As a distributed system running on Hadoop file system, it features one coo...

Data indexing radically accelerates query run time and concurrency without the need for massive compute resources. But before expecting indexing to solve all your needs these are the four things you need to know before this solution will make the desired impact: 1. Indexing is useless if your queries need to perform a full scan To benefit from indexing, you first have to intimately under...

The prevalence of Big Data received a shot in the arm from an unlikely source in early 2020. The widespread impact of Covid-19 saw companies turbo-charge their digital transformation plans, and a wider array of organizations began identifying opportunities by extracting insights through analytics of deep data lakes. This enabled them to discover trends and patterns never before discernable.&nb...

Supercharge your Trino query performance, while slashing compute costs with zero data-ops by using Varada. A rapidly growing number of organizations are adopting both Trino and Varada’s connector as complementary solutions to solve their business challenges. Solving agility and flexibility challenges, while quickly expanding the use of data lake architecture, is no easy feat. Especially wit...

Big data has created a massive challenge for most companies. A massive challenge that requires sophisticated tools to provide better data management. One of these tools is Trino. Trino is a SQL engine. More specifically, Trino is an open-source distributed SQL query engine for ad-hoc and batch ETL queries against multiple types of data sources.  But like any solution, Trino isn’t a per...

Deliver fast time-to-insights and blazing fast queries on exabytes of data directly on the cloud data lake for threat hunting, incident response and security investigations. Security teams are measured by their ability to collect and analyze as much data as possible in a very short period of time. But with so many types of data flowing at massive volumes, security teams are experiencing: ...

With ~80% of compute resources “wasted” on ScanFilter, partitioning is limited in reducing data reads and optimizing query performance for multiple workloads. Here’s why you should be using indexing instead. Presto and Trino have quickly become the tools of choice for data driven companies looking for the agility and flexibility of the data lake architecture. As analytics use cases grow in ...

Accelerate your Trino (PrestoSQL) queries performance and slash compute costs with zero data-ops using Varada Due to its unique advantages, Presto is rapidly gaining momentum in helping companies solve agility and flexibility challenges and quickly expand the use of the data lake architecture. Presto is an open-source distributed SQL query engine for running interactive analytic queries aga...