I haven't replaced all of it - certainly part of it (ie 200grams wholemeal to 300 grams bakers flour). The bakers flour has a stronger gluten content which makes better bread dough. I wonder if you could use all wholemeal if you added some gluten flour (available from health food shops) to make up for the loss of gluten?
Give it a try, and keep us posted on your results!