Zombie plan:

Since I live near the water, I would get a sail boat and fit it a solar power kit to keep small electronics running. I'd stock up on water purification systems and use most of the storage on board for fresh water. I'd also take as much fishing gear on board as possible, as well as dry goods like rice and beans, a lot of vitamin supplements, basic medicine and so on. I'd also buy a couple of solar ovens, which use the heat of the sun to cook food without any external power source. Although I'd try not to run the engine, I'd make sure to keep some stabilized fuel on board for emergencies.

A lot of stuff passes through ports in the US constantly. If you do your research, you could probably do well in raiding port shipping for a long time to supplement the fish that you can catch and your existing food supplies. Depending on where you are, port areas are often also be more industrial than residential, so fewer zombies to encounter there. The only problem with living on the water is that you can't get fresh fruits/ vegetables (other than sea weed), and you run the risk of scurvy and other diseases--so take vitamins. I'd also plan to take several lighter boats so that if my group has to go restock, we don't dock the larger boat and take the risk of it being overrun. To save space, at least some of these would have to be folding/ storable.
Weather would be a serious problem during hurricane season on the east coast. I'd go to inland waterways to avoid the worst of the weather, but this would probably be the most dangerous part of this plan.

If everything on shore goes to hell, then at least I don't have to worry about zombies knocking on my door, and I have steady access to fish and anything else that I can find in the water, and I'm good on water until the purifiers break (at which point, you can still improvise). If someone survives, then long term my group and I could set up a barter system with on shore groups.
Weapons would be a mix of rifles, shotguns, and some short range weapons. The point of being on the boat would be to avoid the heaviest areas of infection, so I'd stay away from ports surrounding larger cities and go for more southeastern ports in the Carolinas or more northern ones in Maine.
I'd only take family and close friends with me. I don't want to be stuck with people who I don't know or don't like, because there's no getting away from them once we get going.

Piracy is an option if we run really low on supplies. Or if we get bored.