If this argument hinges on summarization, then I have to ask - what is the blasted hallucination rate ?
I tried exactly this. Watched 4 talks from a seminar, got them transcribed, and used ChatGPT to summarize this.
Did 3 perfectly fine, and for the 4th it changed the speaker from mild mannered professor into VC investing superstar, with enough successes under his belt to not care.
How do you verify your summary is correct? If your false positive rate is 25% - 33%, thats a LOT of rework. 1 out of 3.
I tried exactly this. Watched 4 talks from a seminar, got them transcribed, and used ChatGPT to summarize this.
Did 3 perfectly fine, and for the 4th it changed the speaker from mild mannered professor into VC investing superstar, with enough successes under his belt to not care.
How do you verify your summary is correct? If your false positive rate is 25% - 33%, thats a LOT of rework. 1 out of 3.