Integrating Feedback Loss from Bi-modal Sarcasm Detector for Sarcastic Speech Synthesis

Denoised Effect

Text	Groundtruth	Denoised
It's just a privilege to watch your mind at work.
I don't think I'll be able to stop thinking about it.

Evaluation

CHANDLER

Text	Groundtruth	Baseline	two-stage Fine-tuned	Proposed
That's a good one too Pheebs, now all that I have to do is find a plane load of people whose resolution is to plummet to their deaths
I thought if I littered, that crying Indian might come by and save us.
Spanish midgets wrestling Julie! Okay yes I see how they got there.
These people find out that a spelling game is going over there, there will be nobody left at our party.
You said you spent all that money because those boots go with skirts, dresses and pants. What do you plan on wearing? A Chicken suit?
Okay, now much have you won so far?

HOWARD

Text	Groundtruth	Baseline	two-stage Fine-tuned	Proposed
They gave him an assistant? If I want a new pen, I have to go to the bank with wire cutters.
Sadly, Mrs. Giselle Wolowitz is sensitive to chlorine. Lucky for her I like my fashion models pruny and bug-eyed.
Interesting. Maybe my male cycle synced up with raj's actual period.
No, she's right. As long as I've known you, you've always been self-conscious
What about people distracted by irritating passengers?
You were a terrible waitress, and we still asked you to get us a snack.

SHELDON

Text	Groundtruth	Baseline	two-stage Fine-tuned	Proposed
Just the latest copy of Applied Particle Physics quarterly.
Provided he has already read and is familiar with the reestablishment of the DC multiverse.
He does it all the time. He's a cornucopia of social awkwardness.
No, but maybe she wants a man with a pocket watch.
Oh, sure, what a wonderful idea. And after that, I'll make up my own rules of oral hygiene. You know, instead of flossing, I'll rub pudding on my gums. I'm going to get the number of the SyFy Channel and give them what for.
Well, now that I've given up string theory, I'm struggling to find my next area of focus. So, in your professional opinion, which of these areas do you think is the most promising?