First decide whether you want to work primarily on software or hardware. IMHO though, this is the era of virtual everything, as it's cheaper (generally speaking), more flexible, and more user-friendly, so...
Easiest route is to work with software. So decide on a sequencer program that has MIDI capabilities that can host VSTs (virtual instruments). This is also known as a DAW program. For electronic music, I recommend Ableton Live. Great audio time stretching capabilities so everything locks into time properly. Or you could try FL Studio, madali rin gamitin yun. May built-in instruments na yun like drum machines and basic synths- pwedeng pwede na for starting out.
Get a midi controller so you'll have better tactile control over your software. The M-Audio O2 is a cheap and decent controller.
Check out Propellerheads Reason also. It's a virtual suite of instruments (synths, drum machine, samplers) and effectors that are perfect for electronic music. May sariling sequencer din sya so you can make whole tracks in Reason alone. Wala nga lang syang audio recording capabilities. But there are workarounds like ReWiring it into your host sequencer.
If you plan to do any recording at all, and if you'll eventually want to take your act live, you'll need an external soundcard. Pero saka na siguro yun. Consider the m-audio fast track series. Those are cheap and cheerful cards.
Then of course, it's crucial to love the music. That's the most critical ingredient. So listen and listen and listen to the artists you like and absorb and never stop learning.