Neural speech editing enables seamless partial edits to speech utterances, allowing modifications to selected content while preserving the rest of the audio unchanged. This useful technique, however, also poses new risks of deepfakes. To encourage research on detecting such partially edited deepfake speech, we introduce PartialEdit, a deepfake speech dataset curated using advanced neural editing techniques. We explore both detection and localization tasks on PartialEdit. Our experiments reveal that models trained on the existing PartialSpoof dataset fail to detect partially edited speech generated by neural speech editing models. As recent speech editing models almost all involve neural audio codecs, we also provide insights into the artifacts the model learned on detecting these deepfakes.
VCTK | E1 | E1-Codec | E2 | E2-Codec |
---|---|---|---|---|
p232_328: They also recovered a picture of Osama bin Laden. |
They also uncovered a picture of Osama bin Laden. |
They also uncovered a picture of Osama bin Laden. |
They also uncovered a picture of Osama bin Laden. |
They also uncovered a picture of Osama bin Laden. |
p232_058: This obsession wasn't just contained within the world of the losers. |
This obsession wasn't just contained within the world of the winners. |
This obsession wasn't just contained within the world of the winners. |
This obsession wasn't just contained within the world of the winners. |
This obsession wasn't just contained within the world of the winners. |
p232_013: Some have accepted it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
p232_380: I decided to tell a bit of the story about myself. |
I decided to hide a bit of the story about myself. |
I decided to hide a bit of the story about myself. |
I decided to hide a bit of the story about myself. |
I decided to hide a bit of the story about myself. |
p232_141: She died at her home. |
She lived at her home. |
She lived at her home. |
She lived at her home. |
She lived at her home. |
VCTK | E1 | E1-Codec | E2 | E2-Codec |
---|---|---|---|---|
p303_058: In essence, the teaching profession has a choice. |
In essence, the teaching profession has a challenge. |
In essence, the teaching profession has a challenge. |
In essence, the teaching profession has a challenge. |
In essence, the teaching profession has a challenge. |
p303_013: Some have accepted it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
p303_053: Jim Wallace, justice minister, has refused to hold an inquiry. |
Jim Wallace, justice minister, has agreed to hold an inquiry. |
Jim Wallace, justice minister, has agreed to hold an inquiry. |
Jim Wallace, justice minister, has agreed to hold an inquiry. |
Jim Wallace, justice minister, has agreed to hold an inquiry. |
p303_347: On this showing, they should stick with the lads. |
On this showing, they should stick with the girls. |
On this showing, they should stick with the girls. |
On this showing, they should stick with the girls. |
On this showing, they should stick with the girls. |
p303_280: And who were they anyway, beforehand? |
And who were they anyway, afterwards? |
And who were they anyway, afterwards? |
And who were they anyway, afterwards? |
And who were they anyway, afterwards? |
VCTK | E1 | E1-Codec | E2 | E2-Codec |
---|---|---|---|---|
p247_333: The people will not be patient. |
The people will not be generous. |
The people will not be generous. |
The people will not be generous. |
The people will not be generous. |
p247_280: Scotland won by six wickets. |
Scotland lost by six wickets. |
Scotland lost by six wickets. |
Scotland lost by six wickets. |
Scotland lost by six wickets. |
p247_215: And they were being paid ? |
And they were being punished? |
And they were being punished? |
And they were being punished? |
And they were being punished? |
p247_113: Our offer represents an attractive price for the business.) |
Our offer represents an excessive price for the business. |
Our offer represents an excessive price for the business. |
Our offer represents an excessive price for the business. |
Our offer represents an excessive price for the business. |
p247_230: William Hague delighted his party.) |
William Hague disappointed his party. |
William Hague disappointed his party. |
William Hague disappointed his party. |
William Hague disappointed his party. |
VCTK | E1 | E1-Codec | E2 | E2-Codec |
---|---|---|---|---|
p311_358: I am greatly encouraged. |
I am greatly discouraged. |
I am greatly discouraged. |
I am greatly discouraged. |
I am greatly discouraged. |
p311_217: This was a lot of numbers. |
This was a lot of words. |
This was a lot of words. |
This was a lot of words. |
This was a lot of words. |
p311_175: His only reply was a laugh. |
His only reply was a sigh. |
His only reply was a sigh. |
His only reply was a sigh. |
His only reply was a sigh. |
p311_143: We've not won anything yet. |
We've not lost anything yet. |
We've not lost anything yet. |
We've not lost anything yet. |
We've not lost anything yet. |
p311_080: We've got a job to do. |
We've got a task to do. |
We've got a task to do. |
We've got a task to do. |
We've got a task to do. |
VCTK | E1 | E1-Codec | E2 | E2-Codec |
---|---|---|---|---|
p256_013: Some have accepted it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
Some have rejected it as a miracle without physical explanation. |
p256_141: We want to keep the pound. |
We want to lose the pound. |
We want to lose the pound. |
We want to lose the pound. |
We want to lose the pound. |
p256_126: There were no grounds for his action. |
There were no grounds for his reaction. |
There were no grounds for his reaction. |
There were no grounds for his reaction. |
There were no grounds for his reaction. |
p256_115: They were behind the wheel. |
They were ahead of the wheel. |
They were ahead of the wheel. |
They were ahead of the wheel. |
They were ahead of the wheel. |
p256_280: For the moment, that is the result of the X-ray. |
For the moment, that is the source of the X-ray. |
For the moment, that is the source of the X-ray. |
For the moment, that is the source of the X-ray. |
For the moment, that is the source of the X-ray. |
@inproceedings{zhang2025PartialEdit,
author = {Zhang, You and Tian, Baotong and Zhang, Lin and Duan, Zhiyao},
title = {{PartialEdit}: Identifying Partial Deepfakes in the Era of Neural Speech Editing},
booktitle = {Proc. Interspeech},
year = {2025},
}