I don't see why you couldn't Sandra. I have actually been thinking of doing the same thing myself
I would just be concerned at the fat content of the cake. If it was a traditional cake recipe using flour, butter, sugar and eggs, and you just replaced the flour with almond meal, you would have fat from the almonds and butter, which would probably work out to be quite a lot. I would try to substitute at least half of the butter with something else such as apple puree or mashed banana to reduce the fat content a bit