Two Harbor is a good idea, but not too practical.
Taking the kayak there is a big issue, the camp ground is ¼ mile uphill hike from the town center.
There might be an area close to beach for camping, but it has to be reserved. If memory serves.
I went there camping and fishing while back. Here is a report about it. It is not kayak fishing, but other information could be useful for deciding.
http://www.pierfishing.com/msgboard/...r+camping+tent
The highlighted orange words were used in “search” mode to find the article.