First ask your self these questions
Do you like fishing ? Probably thats why your asking
Do you like the water ? Probably You like fishing
Do you have a life jacket or know how to swim ? If yes on either one i think you have your basics covered
Having a kayak is very fun, I bough a sea eagle inflatable kayak and it hasnt failed me.
You can go far and beyond were ever you would like to go in the water. it gives you the freedom to row around and fish were you want not just from some boring shore line.
Not only for fishing but for just plain fun ! Go exploring around and just enjoy the surrounding and set up your pole and just row the kayak and maybe a fish will bite at the same time. there big enough to carry small amounts of gear like food extra clothes and other items.
Remember to let someone know where your going and when you leaving and coning back just in case of a kayak emergency keep your phone in a water proof container or bag always wear a lifejacket.