"So good to get away to my farm this past weekend to decompress, take mental inventory and of course - spend time with my babies," the actor wrote, referring to the fish he raises