Recommendations for Speech Analyzation AI
I'm on my capstone year now and we're working on a project that involves AI Speech Analyzation. The AI should analyze the way a human delivers a speech. Then give an assessment by means of Likert scale (1 low, 5 high) on the following criteria: Tone Delivery, Clarity, Pacing, and Emotion. At first, I was trying to look for any agentic approach, but I wasn't able to find any model that can do it.
I pretty much have a vague idea on how I should do it. I've tried to train a model that analyzes emotions first. I've trained it using CREMA-D and TESS datasets, but I'm not satisfied with the results as it typically leans on angry and fear. I've attached the training figures and I kind of having a hard time to understand what I should do next. I'm just learning it on my own since my curriculum doesn't have a dedicated subject related to AI or Machine Learning.
I'm open for any recommendations you could share with me.
Posted Sep 3, 2025, 6:23 PM UTC