Apparently not - as the story continues -
"Gen 9:18 And the sons of Noah, that went forth of the ark, were Shem, and Ham, and Japheth: and Ham is the father of Canaan.
Gen 9:19 These are the three sons of Noah: and of them was the whole earth overspread.
Gen 9:20 And Noah began to be an husbandman, and he planted a vineyard:
Gen 9:21 And he drank of the wine, and was drunken; and he was uncovered within his tent.
Gen 9:22 And Ham, the father of Canaan, saw the nakedness of his father, and told his two brethren without.
Gen 9:23 And Shem and Japheth took a garment, and laid it upon both their shoulders, and went backward, and covered the nakedness of their father; and their faces were backward, and they saw not their father's nakedness.
Gen 9:24 And Noah awoke from his wine, and knew what his younger son had done unto him.
Gen 9:25 And he said, Cursed be Canaan; a servant of servants shall he be unto his brethren.
Gen 9:26 And he said, Blessed be the LORD God of Shem; and Canaan shall be his servant.
Gen 9:27 God shall enlarge Japheth, and he shall dwell in the tents of Shem; and Canaan shall be his servant.
And Numbers 13 tells us the Canaanites are nephilim. So Ham's line continues the nephilim which are NOT Giants. They are the people gone astray.
Gen 10:6 And the sons of Ham; Cush, and Mizraim, and Phut, and Canaan.
Gen 10:7 And the sons of Cush; Seba, and Havilah, and Sabtah, and Raamah, and Sabtecha: and the sons of Raamah; Sheba, and Dedan.
Gen 10:8 And Cush begat Nimrod: he began to be a mighty one in the earth.
Gen 10:9 He was a mighty hunter before the LORD: wherefore it is said, Even as Nimrod the mighty hunter before the LORD.
Gen 10:10 And the beginning of his kingdom was Babel, and Erech, and Accad, and Calneh, in the land of Shinar.
Gen 10:11 Out of that land went forth Asshur, and builded Nineveh, and the city Rehoboth, and Calah,
Gen 10:12 And Resen between Nineveh and Calah: the same is a great city.
Gen 10:13 And Mizraim begat Ludim, and Anamim, and Lehabim, and Naphtuhim,
Gen 10:14 And Pathrusim, and Casluhim, (out of whom came Philistim,) and Caphtorim.
Gen 10:15 And Canaan begat Sidon his firstborn, and Heth,
Gen 10:16 And the Jebusite, and the Amorite, and the Girgasite,
Gen 10:17 And the Hivite, and the Arkite, and the Sinite,
Gen 10:18 And the Arvadite, and the Zemarite, and the Hamathite: and afterward were the families of the Canaanites spread abroad.
Gen 10:19 And the border of the Canaanites was from Sidon, as thou comest to Gerar, unto Gaza; as thou goest, unto Sodom, and Gomorrah, and Admah, and Zeboim, even unto Lasha.
*