As many of my classmates know, I have a passion for baking, with my most recent obsession being brownies.
I set out to conduct an experiment with one simple question: Could ChatGPT create a better brownie recipe than the one I have curated over time?
The first step in this experiment was to generate a recipe using artificial intelligence; my choice was ChatGPT. I requested a “recipe for 9 x 13-inch brownies,” using intentionally vague wording while maintaining the same pan size to ensure a fair comparison. The other experimental constants included ingredient brands, serving size and recipe format.
Next, I began my baking process. The first batch I made was my own recipe, which I know well, so the process went quickly. Once the first batch was in the oven and the timer set, I began the second. This time, I followed ChatGPT’s instructions exactly as written—no more, no less.
The composition of each batter did not vary significantly; both recipes contained the same key ingredients, including butter, eggs, brown sugar, granulated sugar, flour and cocoa powder.
After both batches were baked, I allowed them to cool and waited until the next day for testing. While I waited, I created a short Google Form asking two simple questions for each participant: one rating brownie “X” and one rating brownie “Y.”
For the second part of this experiment, I recruited volunteers. Twenty students and staff members agreed to taste and rate both brownies. Each participant completed a blind taste test, eliminating potential response bias.
I collected the data from the Google Form and analyzed the results. The responses were somewhat surprising: the two similar recipes produced noticeably different outcomes. Brownie X had an average rating of 8.45/10, while brownie Y received an average rating of 7.2/10. Brownie X also had a higher percentage of perfect (10/10) ratings: 25% compared to brownie Y’s 20%.
These differences were relatively small, but I suspect that a larger sample size would have produced more reliable results.
Before the reveal, I would like to thank everyone who participated in this experiment. While the results were close, it appears that the human-made brownies were preferred.
Recipes
ChatGPT Recipe
Ingredients
* 1 cup (2 sticks) unsalted butter
* 2 cups granulated sugar
* 1 cup brown sugar
* 4 large eggs
* 1 tablespoon vanilla extract
* 1 cup all-purpose flour
* 1 cup unsweetened cocoa powder
* 1 teaspoon salt
Instructions
1. Preheat oven to 350°F (175°C). Grease or line a 9×13-inch pan with parchment paper.
2. Melt butter, then whisk in both sugars until smooth and glossy.
3. Add eggs one at a time, mixing well after each addition. Stir in vanilla extract.
4. Add dry ingredients and mix until just combined.
5. Spread batter evenly into the pan.
6. Bake for 25–30 minutes.
My Recipe
**Ingredients**
* 1 cup unsalted Irish butter
* 4 large eggs
* 1 cup flour
* 1 teaspoon baking powder
* 1 cup cocoa powder
* 2 cups granulated sugar
* 1 cup brown sugar
* 2 teaspoons vanilla extract
* ½ teaspoon salt
Instructions
1. Preheat oven to 350°F.
2. Melt butter until fully liquid, avoiding boiling.
3. Mix both sugars into the melted butter.
4. Add eggs one at a time, fully incorporating each.
5. Stir in vanilla extract.
6. Sift flour before measuring, then combine all dry ingredients in a separate bowl.
7. Fold dry ingredients into the wet mixture, being careful not to overmix.
8. Pour batter into a 9×13-inch pan and bake for 25–30 minutes, or until set.
