Preheat oven at 350°F/180°C. Grease a 9x13 baking dish.
Slice the bread into chunks and set aside.
In a separate bowl, whisk together the eggs, sugar, butter, buttermilk, vanilla extract, almond extract, pumpkin purée and the spices. Mix until everything is well combined.
In another mixing bowl, mix the cream cheese, vanilla extract, powdered sugar and buttermilk together.
Place half of the bread into the baking dish then top with the cream cheese followed by the rest of the bread and finally pour the egg mixture over it.
Bake for 45-50 minutes and let it cool for 10 minutes before serving.