You probably want something that gets you started with some hands-on projects, actually building stuff and seeing results. I'd recommend something like the following, and ignore anybody who says "Start with The Art of Electronics" or similar. Not that The Art of Electronics isn't something you might want to get around to eventually. But it's good to get your hands dirty and start building stuff, blinking LED's, etc., early on IMO.
I got one of those Arduino starter kits that comes with a bunch of jumper wires, LEDs, resistors, push buttons, etc. (there's tons of kits, check adafruit.com for some) and learned enough to make an LED blink and went from there. Arduino makes it easy to get your feet wet and you can get more sophisticated once you're comfortable with the basics. Being a software person, the next step I took was ditching the Arduino IDE and writing my firmware in C using avr-gcc to compiler and avrdude to flash. I have an interest in custom USB input devices (game controllers and keyboards) so I've also starting using the LUFA[0] library which is very satisfying once you get it to work (pressing a push button on a breadboard and seeing a character typed on your computer for the first time is great!) So far I've focused on digital circuits, but I'd like to make an amplifier or something to learn more about analog circuitry. As you can see, I'm not too far past the starting line but I feel like I've learned a lot thus far. It's definitely a satisfying hobby.
I'm still in search of good textbooks on the topic (SICP is to CS as ____ is to EE? Recommendations anyone?) but I've gotten some value out of "Make: Electronics"[1] as a non-academic, beginners guide.
https://www.amazon.com/Make-Electronics-Discovery-Charles-Pl...
https://www.amazon.com/Make-Electronics-Journey-Amplifiers-R...
https://www.amazon.com/dp/1680453742/
When you're ready for more of a "textbook" instead of the hands-on stuff, consider the aforementioned The Art of Electronics and/or
https://www.amazon.com/Grobs-Basic-Electronics-Fundamentals-...
Make: Electronics http://www.amazon.com/Make-Electronics-Discovery-Charles-Pla...
Part of the book is breaking things to see how they work which is much cooler than thinking of things as a black box.
I'm still in search of good textbooks on the topic (SICP is to CS as ____ is to EE? Recommendations anyone?) but I've gotten some value out of "Make: Electronics"[1] as a non-academic, beginners guide.
I hope this helps!
[0] https://www.amazon.com/Make-Electronics-Discovery-Charles-Pl...
http://www.amazon.com/Make-Electronics-Discovery-Charles-Pla...