29 Jan '23

Can ChatGPT tackle the AWS Certification Challenge?

Artificial Intelligence has come a long way since its inception, and today we have AI services that can perform tasks with remarkable accuracy and efficiency. One such AI service is ChatGPT, a cutting-edge language model developed by OpenAI that can generate human-like text responses to questions and commands. With the ability to process vast amounts of information in real-time, ChatGPT is revolutionizing the way we interact with technology, making it possible to receive quick and accurate answers to a wide range of questions, without the need for human intervention. In this article, we will explore the evolution of AI and the role that intelligent services like ChatGPT are playing in shaping our future.

AWS certifications are highly valued credentials that demonstrate expertise in AWS cloud solutions. The AWS Certified Solutions Architect - Associate is a foundational certification that validates knowledge of core AWS services, security, and architectural principles, and the ability to design and deploy scalable systems on AWS. This certification is suitable for those looking to pursue a career in cloud computing or showcase expertise to their employer or clients. Let’s see if ChatGPT can tackle the AWS certification challenge.

The Setup

As a consultant, I was intrigued by the capabilities of OpenAI services and ChatGPT in particular. I couldn’t help but wonder if this advanced language model could potentially assist or even replace human consultants in certain tasks. To explore this further, I decided to put ChatGPT to the test by challenging it with the AWS Certified Solutions Architect - Associate exam.

I began by using the 10 official AWS Sample Exam Questions and fed each question into ChatGPT, one by one, without making any changes. To my surprise, ChatGPT accurately answered 8 out of the 10 questions, leading me to question if this was just a coincidence. Determined to put its abilities to the ultimate test, I decided to give ChatGPT the real certification challenge by presenting it with all 65 questions. The results were astonishing and provided valuable insights into the capabilities of this advanced language model.

ChatGPT Sample Question and Answer — Successfull answer by ChatGPT.

The AWS Certification Challenge

The initial results from ChatGPT’s performance on the AWS Sample Exam Questions for the “AWS Certified Solutions Architect - Associate” exam were promising, leaving me eager to discover if ChatGPT could truly pass the certification. The exam is a comprehensive assessment that requires a candidate to correctly answer around 72% of the 65 questions within a 130-minute timeframe. The questions are presented in either multiple choice or multiple response format and are designed to test a candidate’s understanding of AWS core services, security, and architectural principles. To learn more about the specifics of the exam, including the format, content, and assessment criteria, interested individuals can consult the official AWS Exam Guide.

It was time to put ChatGPT to the test. To simulate the actual certification exam, I used unofficial exam questions from Whizlabs. Although these questions may not be identical to the actual AWS certification questions, they are widely used by many professionals to prepare for their exams and provide a comprehensive assessment of knowledge. With each question, I fed it to ChatGPT one-by-one, leaving the questions unaltered. The results were automatically collected by the Whizlabs interactive quiz, providing a real-time evaluation of ChatGPT’s performance.

After the first questions, it was already clear that ChatGPT was performing remarkably well, even answering complex questions with multiple correct answers correctly, one after another. As the test progressed, I began to feel a growing sense of unease - could it really be that AI was on the brink of surpassing human expertise in the field of AWS certifications? This thought was both exhilarating and terrifying, as I remembered the countless hours of study and preparation I had put into earning my AWS Certified Solutions Architect - Associate certification all those years ago. Yet, despite ChatGPT’s impressive performance, the moment of relief came when it finally made its first mistakes, providing a slight sense of relief that AI was not yet ready to take over my job.

Incorrect answer from ChatGPT that was very close — Sooo close. Correct answer was d)

The judgment

ChatGPT amazed me with its performance on the AWS certification exam. It tackled 65 questions in real-time with ease, without any glitches or noticeable delays. Its answers were not just quick but also informative - in cases where it didn’t get the answer right, it usually chose a plausible option and even provided an explanation for its choice. However, it struggled with questions requiring in-depth knowledge and those with multiple similar answers. Despite these challenges, ChatGPT was able to learn from its mistakes and improve its accuracy after being corrected. The big question remained - would ChatGPT’s performance be enough to earn the prestigious “AWS Certified Solutions Architect Associate” title?

Now, I can finally bring some much-needed relief to my readers! The results of ChatGPT’s performance from the AWS certification challenge are in and they are nothing short of remarkable. With an impressive 41 out of 65 answers completely correct, ChatGPT demonstrates a solid 63% accuracy rate, though it falls short of the minimum passing score of 72% required to pass the exam. It’s worth noting that the AWS certified Solutions Architect – Associate exam includes 15 unscored questions, which do not impact a candidate’s overall score. These unscored questions are used by AWS to gather information for future use as scored questions. Additionally, the exam utilizes a scaled scoring model, with results reported as a scaled score between 100-1,000, and a minimum passing score of 720. Given this information, it’s not far-fetched to imagine ChatGPT potentially passing the actual exam, depending on the distribution of unscored questions.

Summary

The recent evaluation of ChatGPT has left me in awe of its capabilities. ChatGPT exceeded my expectations, showcasing strength and proficiency that truly impressed me. It’s exciting to witness the progression of AI and the growth of its capabilities, making it clear that the intelligence of these systems is rapidly advancing. Gone are the days of basic, limited voice assistants - ChatGPT’s performance serves as a testament to the sophistication and potential of modern AI.

At tecRacer, we understand the importance of staying up-to-date in the rapidly evolving field of AWS. If you’re feeling left behind in your knowledge of AWS exam questions, our team of experienced trainers is here to help. Our AWS Trainings offer a comprehensive and practical learning experience, designed to not only prepare you to pass AWS certifications, but to thrive in your career with AWS. Our trainers are real experts (and real humans) in the field, providing personalized instruction and guidance to ensure your success. Whether you’re just starting out or looking to take your skills to the next level, tecRacer’s AWS Trainings are the perfect solution. Don’t wait, start your journey to becoming an AWS expert today!

So, let’s embark on a journey filled with endless opportunities and adventure - the possibilities are truly boundless!

I hope you liked this post. If so, feel free to share. And maybe those lasts words are the only one written by a real human? Who knows…

— Sebastian

Sebastian Moehn

Meet Sebastian, a Cloud Consultant, Trainer and Team Lead at tecRacer Consulting who specializes in Infrastructure as Code and Serverless Architectures. With a focus on AWS Landingzones and a dedication to providing expert guidance, Sebastian leads the charge in ensuring that his clients are equipped to succeed in the dynamic world of cloud computing.

Similar Posts You Might Enjoy

26 Apr '23

Using AI to generate Terraform Code from actual AWS resources

The world is changing, with new AI tools emerging every day. One such tool that has been making waves recently is ChatGPT. It is only the first of many such tools hitting the market, and it urges us to think about the future of our work. I recently used it to help with a standard task that I often perform and was amazed by how well it helped me to automate it. - by Fabian Brakowski

22 Mar '23

Creating a CSV Decimal Converter Tool: A Chatbot's Perspective

This blog post was completely generated by ChatGPT and not modified in any way. As an AI language model, my purpose is to assist and empower users with diverse tasks, from answering questions to helping develop custom tools. Recently, an IT consultant approached me for help in creating a Python script to convert a CSV file from US decimal format to German decimal format. - by ChatGPT

23 Dec '23

Streamlined Kafka Schema Evolution in AWS using MSK and the Glue Schema Registry

In today’s data-driven world, effective data management is crucial for organizations aiming to make well-informed, data-driven decisions. As the importance of data continues to grow, so does the significance of robust data management practices. This includes the processes of ingesting, storing, organizing, and maintaining the data generated and collected by an organization. Within the realm of data management, schema evolution stands out as one of the most critical aspects. Businesses evolve over time, leading to changes in data and, consequently, changes in corresponding schemas. Even though a schema may be initially defined for your data, evolving business requirements inevitably demand schema modifications. Yet, modifying data structures is no straightforward task, especially when dealing with distributed systems and teams. It’s essential that downstream consumers of the data can seamlessly adapt to new schemas. Coordinating these changes becomes a critical challenge to minimize downtime and prevent production issues. Neglecting robust data management and schema evolution strategies can result in service disruptions, breaking data pipelines, and incurring significant future costs. In the context of Apache Kafka, schema evolution is managed through a schema registry. As producers share data with consumers via Kafka, the schema is stored in this registry. The Schema Registry enhances the reliability, flexibility, and scalability of systems and applications by providing a standardized approach to manage and validate schemas used by both producers and consumers. This blog post will walk you through the steps of utilizing Amazon MSK in combination with AWS Glue Schema Registry and Terraform to build a cross-account streaming pipeline for Kafka, complete with built-in schema evolution. This approach provides a comprehensive solution to address your dynamic and evolving data requirements. - by Hendrik Hagen

Share