Says Wikipedia:

The first film sequel to be named by simply adding a "2" (or rather, "II") after the original's title was "French Connection II". (OK, and removing the article.) (See the article on sequel.) Unfortunately, no source for this is provided. It would be cool to know this for certain.