Amazon Athena facilitates data analysis without having to set and manage data processing infrastructure. Traditionally, however, you had to set Amazon Simple Storage (Amazon S3) bucket to save the results before they could run ode with Athena. Needs arose to make it easy to start using Athen, with fewer settings.
That is why we are shown by introducing the results of the questions, a new feature of Athena, which automatically stores, provides and manages the life cycle of data on the results of the inquiry for you without further costs. The results of the installed query simplify your user experience by removing the need to create or select the S3 bucket at birth to preserve the results before starting the questions. It helps to reduce your monthly costs by moving temporary depositing the results of the S3 bucket to Athen and eliminating the need for separate processes to remove the data about the results of your S3 bucket after it is not necessary. Now Athena offers managed services, temporary storage and customer has managed the possibilities of Amazon S3 storage to meet different needs.
What’s more, the use of the results of the managed query does not require comprehensive changes in applications that read the results from the existing Athena interface, and increases data security. Access to the results of the results of the installed query are now associated with the AWS Identity and Access Management (IAM) permissions, which was instead of the S3 S3 buckets. In addition, you can automatically encrypt data about AWS Key Management Service (AWS KMS) using AWS or managed keyboards for customer.
In this post, we demonstrate how to start with the results of the installed query and by removing an undivided effort spent on managing the results of the Question results will help you get information from your data in a smaller number of steps than before.
Solutions
When you use the results of the installed query, you do not have to create and select S3 buckets for storing the results of the query or manage the rules of the life cycle to make sure that the results are elegantly cleaned. Below are scenarios where it is an advantage:
- Financial analysts working in teams analyzing market data, each covering different investment areas or financial tools, can use different working groups for different types of analysis or projects. Analyst now you must spend time setting S3 buckets or worry about cleaning the query results when their work is completed.
- Compliance teams can conduct audit questions about transaction data for regulatory reporting and at the same time ensure that only authorized team members can do the available sensitive results by IAM. Since the results of the query are automatically cleaned, the team for compliance is not a long requirement of separate processes to remove the query results.
- Teams for data and analysts and platforms that are responsible for the effective deck of new users and teams no longer have to configure individual buckets and S3 permissions for different users and teams, simplifying their automation code.
Below are some of the key features of the results managed in Athena:
- Before starting questions, it removes the need to choose a S3 bucket rental.
- There is no additional cost of storing the query results and the results of the query are automatically removed for a period of time, which reduces control from a separate bucket cleaning process.
- It is easy to start: the new and existing working groups can be smoothly configured to use the results of the installed query. At the birth of AWS you can have a mixture of athena managed and the results of managed customers.
- With access to reading results, you can use Effective Iam Permissions
GetQueryResultsandGetQueryResultsStreamTied to individual working groups. - The query results are automatically encrypted using your KMS managed KMS AWS.
Let’s go through how to start with the results of the installed query.
Configure your working group
Configuration of the working group Complete the following steps:
- On the Athena console, choose Working group In the navigation pane.
- Choose Create a working group.
Alternatively you can choose an existing working group and choose Edit.
- For Configuration of Query Resultselect Athena succeeded.
- Go to Athena. You want to create a new work group, select on the working groups page Create a working group Button. If you want to edit an existing working group, select a working group from the list and on the Details page, select Edit Button. Under the configuration of the Query Result you will see the option for Athena succeeded::
- For Question encryption resultsSelect your preferred encryption method
Figure 1: Configuration of Query Result
Step 2: Encryption configuration
Select your preferred encryption method for query results:
-
- Cipher using the key of the owned AWS – This is the default option. This means that you want the query results to be encrypted and decrypted by the AWS key.
- Cipher using the key managed customer – Select this option if you want to encrypt and decrypt the query results using your own key. Have Athena use the key managed customer, a specific Athena service in
PrincipalElements of key policy. For more information, see AWS KMS Settings Key Policy for Managed Storage. To start the queries, you need to ask users’ permission to access your key.
Inquiry your data
After configuring the working group for the results of the managed query, you can imitate the start of queries. Let’s run a sample query against the cost of AWS cost and use.
Athena’s banner indicates that our working group, demo-workgroupIt has been updated for the use of the results of the installed query. Our question was running successfully and we didn’t have to set the S3 bucket. You want to download these results, choose Results to download CSV.
Figure 2: Start Question Against Cost and Use in Athena
You can access these results via the Athena console and using ATIS APIS APIS.
Figure 3: Access to the Query results via the ATHENA API API
Conclusion
In this post, we introduced the results of Managed Query Results, a new feature of Athena, which streamlines the interviewing experience via automated storage of query results, provides automatic cleaning and limits access to the IAM permissions. The results of the inquiry reduce the operating overhead costs and empowers how data analysts who run interactive questions and teams that create a complex analytical pipe to focus on deriving knowledge rather than misleading infrastructure. We have shown how to configure working groups for managed storage and use this feature efficiently in queries scenarios.
If you want to start using the results of the directed query with Athena, the simple configure the working group via the console or API Athena. For more information, see the results of the managed query.
About the authors
GUY BASHAR is sr. Solution architects at AWS. He specializes in Asting Capital Markets and Fintech customers with their trips to transform the cloud. His expertise Klackss is managed by the management of identity, security and unified communication.
Sayan Chakraorty is sr. Solution architects at AWS. It helps large businesses to build safe, scalable and business solutions on AWS. With the background of corporate and technological architecture, he has experience in providing large digital transformation programs across a wide range of industrial verticals.
Darshit Thakkar He is a technical product manager in AWS and works from Boston in Massachusetts. It works closely with customers to understand how they use data and controls product innovations that make data more than more.