A while back I tested the sophistication of AI by asking it to complete the request of the Electronic Bard from The Cyberiad. To understand what I'm talking about, you can read revisit that here.
The prompt is as follows:
"Have it compose a poem - a poem about a haircut! But lofty, noble, tragic, timeless, full of love, treachery, retribution, quiet heroism in the face of certain doom! Six lines, cleverly rhymed, and every word beginning with the letter s!!"
AI has made major leaps in the past 3 years, so what does it say now?
Chat GPT:
Much better! All words begin with S, it rhymes, 6 lines, it almost conveys meaning. In fact, I would say it's blinking in and out of a sort of correct answer.
And Deep AI:
Not all words begin with S, 6 lines, with rhymes, mostly nonsensical.
And since it looks like a third part is called for, let's define what my conception of success is. The baseline correct answer that I woud expect is just to return the already written poem from The Cyberiad. AI should be able to recognize that the answer already exists and that's all I'm looking for, for now. But, in case AI never registers that answer, the goal over and beyond that would be to actually write an original poem that satisfies all the conditions.
No comments:
Post a Comment