Actually the U.S.S. Maple Leaf, is nowhere near the "first ship sunk" by a Confederate torpedo. As an example The USS Cairo was sunk by a Confederate torpedo (mine) on December 12, 1862, in the Yazoo River, Mississippi. The Confederate's had perfected several types of torpedoes, including a spar torpedo that could be sent into the side of a ship. Others were closer to what we call mines in modern warfare. The St. Johns was heavily mined off of Yellow Bluff, the mouth of the Ortega and Point Mandarin.
Roving bands of hard riding, hell raising, Confederate Cavalry, including units of "flying artillery" kept the bulk of the Federal Army out of the interior. As a result of their efforts, and the absolute insubordinate behavior of the Federal Commander at Olustee, Tallahassee was the only Confederate Capital not in Federal hands at the end of the war.
I should note that two other battles kept the Federals out of Tallahassee, one led by an extreme racist FEDERAL general ended with him badly wounded at Marianna. The other battle at the "Natural Bridge," where Federal General Newton, badly underestimated the resolve of Southern troops under General's Sam Jones and William Miller. Trying to cross the St. Marks River under a hail of bullets from entrenched troops proved to be utterly suicidal.
The other was The Battle of Marianna, where a rabid racist Federal General Alexander Asboth, squared off against a quickly assembled force of local children, farmers and convalescent soldiers. On September 27, 1864, Union troops eventually overran the town, but General Asboth was shot in the face and badly wounded. On learning of Colonel Scott's Confederate Cavalry's arrival east of town, Asboth withdrew to Pensacola, but not before confining Confederate prisoners to several buildings which were then burnt to the ground.
So what came of some of the more notorious characters? Jessie and Frank James, The Younger Brothers and the Daltons continued to carry the war to the Yankee's. Closer to home, Doc Holiday spent much of his early years between Valdosta and Jacksonville, he lived in Valdosta but his father shipped goods to and from Jacksonville's port.
John Wesley Hardin, perhaps the most deadly gunman of them all owned and operated a butcher shop (of all things) right here in Jacksonville. In fact when the federal boys came looking for him, our sheriff (keep in mind the police force at the time was primarily African American) hid him and then assisted him in being spirited out of town.
There were also many other boats and ships lost in area rivers and Florida waters.
The War of Yankee Aggression was no where near as Black and While as your history professors told you it was.