Investigators say the murder happened at the Northeast Correctional Complex in Mountain City.
They say the incident happened in the middle of a fight between several inmates.
Around 10 O'clock Saturday morning a 24-year-old inmate was pronounced dead.
They are not releasing his name until relatives can be notified.
As with all in-custody deaths, the Tennessee Department of Corrections has asked the TBI to assist in the investigation.