Snowflake Usage Dashboard – Qlik Sense

Snowflake Usage Dashboard – Qlik Sense


Hey everybody my name is Dave Freriks and I’m a technology evangelist here at Qlik And today we’re gonna talk about the
Snowflake usage dashboard This is a guide to show you how to use Qlik in order to monitor your Snowflake metadata And usage costs So why is Qlik the best vendor to work with Snowflake What makes our technology and breadth and depth of integration so unique That we offer a very valuable proposition to take best advantage of the power of the Snowflake engine Let’s learn a little bit more about
why Qlik is so special in this space Qlik is unique in that we’re going to be able to provide raw data to shared insights Through the entire data analytics
and data integration platform Starting from being able to manage your
data on Snowflake Through use of the Qlik associative engine
to provide top-line analytics And visual understanding of data including data science And predictive integration with server-side extensions for Python and R And then being able to deliver that information whether it be managed reporting Guided dashboards, self-service analytics,
embedded mobile Or now with our speed of thought conversational analytics bot Let’s take a quick peek at a reference architecture for Qlik and Snowflake on the left, we’re going to start with our data Whether it’s in a relational system, a mainframe SAP,
or whatever We’re gonna grab that information
we’re gonna load it into Snowflake Which live change data capture We’re going to transform it in an automated fashion with Attunity compose For creation of data warehouse
models and data Mart’s We’re gonna catalog the information And we’re gonna be able to consume that then with Qlik Sense and the Associative Engine And all of this together constitutes our data integration and data analytics pipeline for Snowflake Opening up the actual usage dashboard We’re going to come in here and take a look at what sort of contents we provide We start with a little table of contents So it easy to navigate being able to understand what’s contained inside of the app But as we go on and start doing our exploration We’re going to be able to do is very quickly understand The cost associated with how much data and how much usage we’ve consumed inside The Snowflake system Storage cost billed usage cost billed credits used by warehouse Being able to understand a little bit about what users are running the most queries We’re also able to add some value around what users are also causing the most cost And these may not be directly correlated What’s interesting about that is that sometimes usage is different than queries So being able to dive into that and understand this relationship This is somewhat of a unique value by Qlik Being able to understand this and the way that we
model our data with associative engine Being able to see the queries that are
being used, select queries, all queries I’ll take a look at myself here and see that in the last 12 months I’ve used 528 dollars worth Of a Snowflake usage Let’s go ahead and move along here to looking at a slightly different view of this Which is going to be sort of our enterprise dashboard This is using a predictive engine To be able to anticipate based on my last six months of usage When am I going to run out of my urchase set of credits we bought 600 credits, if I take a look at this Looks like in about four months with average
use case I’m gonna run out of credits It”s important to know I want to make
sure that I don’t run out of credits and get charged more So again different way of using the dashboard Looking at auditing and security here we can see who logged in where they logged in From what IP click offers a geo analytics
engine which does dynamic IP lookup So, we can actually visualize where users
are coming in from around the world Some of the other features we’ve added to this dashboard allow you to understand How users are logging in Are they successful, are there failures, are they using primary authentication Or are there secondary authentication methods contained here inside the dashboard We can also see when those spikes of logins
are occurring So being able to really understand again how I logged into the system Most of the time I’m coming in from Washington, I’ve got Comcast, so it’s routing to kind of Whatever system that had decided to connect me the internet that day But when I come in via VPN you can see that our VPN is going to be located in Virginia And that allows me to kind of understand those usage patterns Now coming into our final piece
of the puzzle we’re gonna be able to see Performance optimization perform its
usage Who’s returning the most amount of data How long our query is running,
what are the usage patterns if I click on this one example here,
what I can see is that At some point somebody ran a query that
returned 28 million records And that 28 million record returned ran for a certain amount of minutes It cost me $40 that one query cost $40 We can also do some storytelling mode which I can then go through and highlight Who’s using what, who’s using it when
and be able to tell a story around our Snowflake integration So again being able to deliver stories not just analytics as part of the Qlik stack Now finally where can you go and get this
information So I’ve published this project out on Github And it is freely
available for anyone to download and use There are two versions there’s a
lightweight and then there’s a predictive version I’ve attached the
instructions inside of this Github The link is here at the top of the page if
you want to go ahead and check that out But being able to come in download this
and plug this into your Snowflake Instance is a very quick and easy thing
to do Just requires your some logon credentials and some other notes that are placed in there So with that thank you so much for spending some time learning about Qlik and Snowflake integration There’s a lot more to learn about Qlik And I really appreciate you
taking the time to watch this video

One comment

Leave a Reply

Your email address will not be published. Required fields are marked *