As a person who has done some packing in the Sierra's I have to say...your not crazy at all for wanting to go for it.
There is just nothing like being way out in the back country where there is no noise other than you your horse and the wilderness...
I think it is a wonderful idea, and truly hope you will fulfill your dream!
I've always wondered what it would be like to just kinda live off the land and drift....where there is no modernalities....
If I hear your passing through the sierra's....I will join up! :)