Check out definition of discrete Gaussian curvature. For me, it seems that the formula that vtkCurvatures uses in Gaussian mode is correct for internal vertices but incorrect for edge vertices.
A simple solution is what is suggested above: ignore curvature of edge vertices.
A nicer solution would be compute curvature of edge vertices by averaging curvature of nearby internal vertices.