#18. An AI Meta-Analysis of Postpostmodern Compositionist
In my last blog post, I mentioned that the next two blog posts would feature articles from Composition & Resistance. Those posts are definitely still coming, but I had an interesting idea I have been thinking about over the past few months, and this week I couldn't help myself in deciding to move it to the top of the docket. At the end of the day this is my blog, so I change the rules whenever I want, right?
Trust me, I have no illusions. I am aware that my blog doesn't get much traffic, if any at all. However, I did notice that Blogger's country-tracking feature shows visitors from over 18 countries, including Kenya, Turkey, and Vietnam. I am not sure how these people are finding my blog or why they are interested in it (perhaps they are rhetoric & composition scholars?), but I also suspect that they might be bots who are scraping the internet for text they can use to train AI models.
Aside: This is a direct comment for people who might be reading this: If you feel so inclined, leave a comment on this post making your presence known. I genuinely would be curious to know if sentient beings are actually reading this blog. If I see no comments, I am going to assume that these views are simply from bots. Hopefully, I am not just talking to the wall.
Okay, back to the point about my writing being used to train AI models. No matter how obscure this blog is, it is still publicly available, and I understand that I have no control over what people (or bots) may be doing with my writing. I imagine that this is simply part of maintaining a digital presence in 2026. Again, whether bots are actually scraping my blog posts is complete conjecture. I have no idea of knowing whether they are or not, and perhaps I am paranoid and the views are actually organic views. Regardless, for this reason I have no qualms about running my blog posts through AI, so I thought I would conduct an experiment.
I copied and pasted all of my blog posts into a Word document and input them into three large language models: 1) Google Gemini (3.6 Flash), 2) OpenAI's ChatGPT (Auto mode), and 3) Anthropic's Claude (Sonnet 5). Along with the blog posts, I also input the following prompt to direct the models: "Here are all of the posts from my scholarly blog. Please identify three patterns you notice throughout these posts. For each pattern, quote or paraphrase small pieces of my writing as evidence (which you will only draw from the text I provided). Limit your response to three short paragraphs." It is important to note that I am using the free versions of all these chatbots.
One might ask, Casey, why do this? What could AI possibly tell you that you can't figure out yourself? Why give your data freely to these large AI companies? These are all fair questions, but as someone who is becoming a qualitative researcher and who has received a robust methodological training in qualitative methods over the last two years, I have been sold on the affordances of AI as an effective tool to conduct qualitative analysis. I do think that AI does a fairly good job of detecting patterns and trends across a large corpus of texts, and many times when I have run an analysis of my writings through AI, it does allow me to get a fresh perspective and consider blind spots. However, I will emphasize that qualitative analysis is a subjective process and that while AI analysis can augment human analysis, it should never replace it. Though most AI models have come a long way since 2022, in my opinion their outputs often can still feel unremarkable and generic. Again, the limited perspective of a large language model should ideally just be one amongst a variety of other human perspectives. Without much ado, let's get into the AI outputs.
1. Google Gemini
See Image 1 for Gemini's output. Out of the three large language models, I thought this output was the most idiosyncratic, in that its points had less crossover with the other models. With this said, the first finding is rather unsurprising, as the whole point of this blog is to consider past composition texts against the present day. I did not input the description of my blog and perhaps I should have. At the same time, I do feel that it assuages my worry that I deviate too much from the overall concept of the blog. It appears as if I am mostly conforming to the blog's mission and this is comforting to hear.
| Image 1: Output from Google Gemini |
| Image 2: Output from OpenAI's ChatGPT |
Comments
Post a Comment