I don't recommend people think in terms of "beginner" kayak (or canoe). Short wide boats may feel "safe" at first but they are slow and balky to paddle and have limited range of use. Most people who really get into paddling feel disappointed and frustrated quickly with these "recreational" style boats. Within a few hours of getting the hang of paddling, most people want more speed and easier tracking than these things can handle. Considering them "beginner" boats is like thinking you need to start riding a bike by buying a 3 speed clunker. Also, a shorter wider kayak is NOT a guarantee against "tipping" -- in fact they are more likely to be turned over by a large power boat wake and can be more difficult to flip back over and re-enter if you do fall out. All this goes for the inflatables the first answer mentioned. They are very slow and get blown around by the waves and wind. Few people use them for any serious overnight trips. There are better inflatables, like the Innova series, but sea eagles and sevylors are a bit like glorified pool toys.
But before you buy a kayak or canoe at all, I strongly recommend you take an introductory class at an outfitter's. Paddling correctly is NOT a naturally intuitive thing, like most people think. I see people out all the time doing it wrong and risking shoulder injuries and fatigue. And there are safety drills and considerations you need to be aware of. Plus, in taking a class you get to try out a variety of boats in most cases. Before you spend several hundred dollars you should be test-paddling some boats at a good kayak dealer. A kayak needs to fit your body size, too. (Canoes are not as specific but you still need to know if you will use it solo or tandem or both.) I can't give you exact models to look at not knowing your height, weight and athletic ability (also your budget).
For the camping and fishing a canoe would be more useful, honestly.
Please find a good kayak and canoe dealer in your area. NOT a big box sports store (avoid D1cks, Dunhams, Cabelas, Gander, Walmart, BassPRo, etc.) Usually a qualified paddle sport dealer will be a shop that specializes in just boating or also has rock climbing and backpacking gear. REI, EMS (if they have not all closed) and even L.L. Bean stores are pretty good for kayak and canoe selection and have people qualified to advise and fit you. They also offer the classes I reoommended,
Meanwhile, you can read up quite a bit on kayaks and canoes and all of the aspects of paddling at the free paddlers site: http://www.paddling.net
Good advice on everything having to do with kayaking and canoeing on there. There are literally hundreds of kayak and canoe models on the market -- you have much to learn, Grasshopper! :-)
But it will be worth it in the end when you find the boat that is just right for you. Don't rush into it.