Grease at the right place makes all the difference. All along I thought it was the hinge, or the caliper, but it turns out it was where the brake lever meets the hydraulic piston.