Libya's Muslim Brotherhood party, the second largest group in the country's parliament, withdrew its five ministers from their government posts Tuesday.