Dataset Logo

PartialEdit: Identifying Partial Deepfakes in the Era of Neural Speech Editing

Interspeech 2025

1Audio Information Research Lab, University of Rochester
2Speech@FIT, Brno University of Technology
*Equal Contribution

Neural speech editing enables seamless partial edits to speech utterances, allowing modifications to selected content while preserving the rest of the audio unchanged. This useful technique, however, also poses new risks of deepfakes. To encourage research on detecting such partially edited deepfake speech, we introduce PartialEdit, a deepfake speech dataset curated using advanced neural editing techniques. We explore both detection and localization tasks on PartialEdit. Our experiments reveal that models trained on the existing PartialSpoof dataset fail to detect partially edited speech generated by neural speech editing models. As recent speech editing models almost all involve neural audio codecs, we also provide insights into the artifacts the model learned on detecting these deepfakes.

PartialEdit Curation Process

PartialEdit curation process illustrated using the utterance \texttt{p226\_001} from the VCTK dataset. The original speech is modified to produce ``Please ignore Stella,''  where the speech segment corresponding to ``ignore'' is synthesized, making it the \textbf{partial deepfake} within the newly edited utterance.

Audio Samples

p232

VCTK E1 E1-Codec E2 E2-Codec

p232_328: They also recovered a picture of Osama bin Laden.

They also uncovered a picture of Osama bin Laden.

They also uncovered a picture of Osama bin Laden.

They also uncovered a picture of Osama bin Laden.

They also uncovered a picture of Osama bin Laden.

p232_058: This obsession wasn't just contained within the world of the losers.

This obsession wasn't just contained within the world of the winners.

This obsession wasn't just contained within the world of the winners.

This obsession wasn't just contained within the world of the winners.

This obsession wasn't just contained within the world of the winners.

p232_013: Some have accepted it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

p232_380: I decided to tell a bit of the story about myself.

I decided to hide a bit of the story about myself.

I decided to hide a bit of the story about myself.

I decided to hide a bit of the story about myself.

I decided to hide a bit of the story about myself.

p232_141: She died at her home.

She lived at her home.

She lived at her home.

She lived at her home.

She lived at her home.

p303

VCTK E1 E1-Codec E2 E2-Codec

p303_058: In essence, the teaching profession has a choice.

In essence, the teaching profession has a challenge.

In essence, the teaching profession has a challenge.

In essence, the teaching profession has a challenge.

In essence, the teaching profession has a challenge.

p303_013: Some have accepted it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

p303_053: Jim Wallace, justice minister, has refused to hold an inquiry.

Jim Wallace, justice minister, has agreed to hold an inquiry.

Jim Wallace, justice minister, has agreed to hold an inquiry.

Jim Wallace, justice minister, has agreed to hold an inquiry.

Jim Wallace, justice minister, has agreed to hold an inquiry.

p303_347: On this showing, they should stick with the lads.

On this showing, they should stick with the girls.

On this showing, they should stick with the girls.

On this showing, they should stick with the girls.

On this showing, they should stick with the girls.

p303_280: And who were they anyway, beforehand?

And who were they anyway, afterwards?

And who were they anyway, afterwards?

And who were they anyway, afterwards?

And who were they anyway, afterwards?

p247

VCTK E1 E1-Codec E2 E2-Codec

p247_333: The people will not be patient.

The people will not be generous.

The people will not be generous.

The people will not be generous.

The people will not be generous.

p247_280: Scotland won by six wickets.

Scotland lost by six wickets.

Scotland lost by six wickets.

Scotland lost by six wickets.

Scotland lost by six wickets.

p247_215: And they were being paid ?

And they were being punished?

And they were being punished?

And they were being punished?

And they were being punished?

p247_113: Our offer represents an attractive price for the business.)

Our offer represents an excessive price for the business.

Our offer represents an excessive price for the business.

Our offer represents an excessive price for the business.

Our offer represents an excessive price for the business.

p247_230: William Hague delighted his party.)

William Hague disappointed his party.

William Hague disappointed his party.

William Hague disappointed his party.

William Hague disappointed his party.

p311

VCTK E1 E1-Codec E2 E2-Codec

p311_358: I am greatly encouraged.

I am greatly discouraged.

I am greatly discouraged.

I am greatly discouraged.

I am greatly discouraged.

p311_217: This was a lot of numbers.

This was a lot of words.

This was a lot of words.

This was a lot of words.

This was a lot of words.

p311_175: His only reply was a laugh.

His only reply was a sigh.

His only reply was a sigh.

His only reply was a sigh.

His only reply was a sigh.

p311_143: We've not won anything yet.

We've not lost anything yet.

We've not lost anything yet.

We've not lost anything yet.

We've not lost anything yet.

p311_080: We've got a job to do.

We've got a task to do.

We've got a task to do.

We've got a task to do.

We've got a task to do.

p256

VCTK E1 E1-Codec E2 E2-Codec

p256_013: Some have accepted it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

Some have rejected it as a miracle without physical explanation.

p256_141: We want to keep the pound.

We want to lose the pound.

We want to lose the pound.

We want to lose the pound.

We want to lose the pound.

p256_126: There were no grounds for his action.

There were no grounds for his reaction.

There were no grounds for his reaction.

There were no grounds for his reaction.

There were no grounds for his reaction.

p256_115: They were behind the wheel.

They were ahead of the wheel.

They were ahead of the wheel.

They were ahead of the wheel.

They were ahead of the wheel.

p256_280: For the moment, that is the result of the X-ray.

For the moment, that is the source of the X-ray.

For the moment, that is the source of the X-ray.

For the moment, that is the source of the X-ray.

For the moment, that is the source of the X-ray.

BibTeX

@inproceedings{zhang2025PartialEdit,
      author    = {Zhang, You and Tian, Baotong and Zhang, Lin and Duan, Zhiyao},
      title     = {{PartialEdit}: Identifying Partial Deepfakes in the Era of Neural Speech Editing},
      booktitle   = {Proc. Interspeech},
      year      = {2025},
    }