BI Engine and materialized views give organizations performance gains across any business intelligence tool, from Google’s Looker and Connected Sheets to Tableau to Microsoft Power BI, and more.
Google Cloud recently announced two powerful enhancements that will continue to meet the customer demand of reducing time to insight and increasing the performance of BigQuery. BI Engine and materialised views for BigQuery build upon the open, intelligent and flexible Google Cloud platform to provide sub-second query response time and high concurrency. Through these enhancements, the performance gains allow organisations to provide employees with increased access to data at scale and empower them to make fast data-driven decisions that directly impact the business.
Supporting Google’s open data cloud strategy, BI Engine is now previewing out-of-the-box integration with Looker and Google’s Connected Sheets, as well as continued support for Data Studio. BI Engine is also available for third-party partners such as Salesforce’s Tableau, Microsoft’s Power BI or any custom-built or partner business intelligence (BI) tool.
“Our business users are hungry for data and expect a lot from our team, so as soon as we had the opportunity to turn on BI Engine for BigQuery and Looker, we did, and the performance-matched to the speed of business expectations and greatly improved the load times for dashboards,” said Harish Ramachandraiah, Director of Engineering and Analytics at Sunrun. “This fast in-memory analysis service allowed the marketing, sales, and operations business users to analyse large and complex datasets interactively in Looker and Data Studio.”
Kiran Manne, the Google Cloud Architect on the BI team at Sunrun, added, “It helped the development team too, with its simplified architecture for getting started quickly without managing complex, post-ETL transformations and data pipelines. We saw 40% performance increases, and we have 1000+ users interacting with the data daily via Looker and Data Studio, so this was a very effective way to improve their data experiences, save them time, and positively impact the data culture at Sunrun.”
BI Engine intelligently creates configuration settings using smart tuning capabilities to ensure optimal performance and overall load times for dashboards. This function is executed in the background every time data changes or is added, guaranteeing new and fast data for all queries. This functionality occurs automatically, causing zero maintenance for analytics teams.
Also, now generally available, BigQuery materialised views (MVs) significantly boosts the performance of workloads that have the characteristic of common and repeated queries. MV’s in BigQuery are unique as they offer a modern approach with zero required maintenance and ensure data is always fresh. By providing precomputed views that periodically cache results of a query, MV’s provide a faster query performance and acceleration of real-time data.
“Query latency is critical in our case were reporting data is directly consumed by the UI which processes ~8,000 SQL queries per day with each query needing to complete in under a second: this innovation not only came with great cost reduction but it also hugely improves performance,” says Adrian Witas, Senior Vice President, Chief Architect at Viant.
“To achieve their business goals, customers need real-time insight. BI Engine enables them to get sub-second response time, regardless of the BI tools they use. With no changes, users automatically get lightning-fast analytics in the applications they already use and love. We’re excited to work with partners like Microsoft, Tableau and the rest of the community to advance our goal further to democratise access to data by providing the world’s best analytics experience,” said Debanjan Saha, GM, data analytics at Google Cloud.
This announcement of BI Engine and MV’s further extends Google’s open cloud strategy for multi-cloud analytics. The announcement deepens the company’s commitment made during the launch of BigQuery Omni, the company’s multi-cloud analytics solution, which customers can use to cost-effectively access and securely analyse data across Google Cloud, Amazon Web Services (AWS), and Azure (coming soon).
BI Engine is now natively integrated into BigQuery’s API and architecture, so customers always work with the most up-to-date data. Materialised views are also automatically available for use in BigQuery starting today.
“Customers are always looking for ways to improve query performance, and we’ve been working closely with the BigQuery team to ensure we meet this demand. The launch of BI Engine for Looker makes querying extremely fast. Common use cases in Looker include the analysis of large data sets or streaming data where speed and freshness are important. Simply put, BI Engine will greatly accelerate our customers’ experience with Looker,” says Ronaldo Ama, GM at Looker, Google Cloud.
“When a company runs on data, speed, agility and empowerment are critical to achieving competitive advantage. Combining Tableau’s ease of use and flexibility with the power and scale of Google’s BigQuery BI Engine will rapidly unlock the power of data for even more people,” says Francois Ajenstat, Chief Product Officer at Tableau Software.
