I would baptize my children. It's always been the custom of the Church, and it was commanded by Christ.
Matthew 28:19 19 Go therefore and make disciples of all the nations, baptizing them in the name of the Father and of the Son and of the Holy Spirit,
If for no other reason, be baptized to follow Christ's example, for He was baptized.
Matthew 3:
13 Then Jesus came from Galilee to John at the Jordan to be baptized by him. 14 And John tried to prevent Him, saying, “I need to be baptized by You, and are You coming to me?”
15 But Jesus answered and said to him, “Permit it to be so now, for thus it is fitting for us to fulfill all righteousness.” Then he allowed Him.
16 When He had been baptized, Jesus came up immediately from the water; and behold, the heavens were opened to Him, and He saw the Spirit of God descending like a dove and alighting upon Him. 17 And suddenly a voice came from heaven, saying, “This is My beloved Son, in whom I am well pleased.”
Also, in Acts, people were initiated into the Christian life through baptism:
Acts 2:38 Then Peter said to them, “Repent, and let every one of you be
baptized in the name of Jesus Christ for the remission of sins; and you shall receive the gift of the Holy Spirit.
Also, Romans 6 gives very detailed reasons as to exactly why we should be baptized:
3 Or do you not know that as many of us as were baptized into Christ Jesus were baptized into His death? 4 Therefore we were buried with Him through baptism into death, that just as Christ was raised from the dead by the glory of the Father, even so we also should walk in newness of life. 5 For if we have been united together in the likeness of His death, certainly we also shall be in the likeness of His resurrection, 6 knowing this, that our old man was crucified with Him, that the body of sin might be done away with, that we should no longer be slaves of sin. 7 For he who has died has been freed from sin. 8 Now if we died with Christ, we believe that we shall also live with Him, 9 knowing that Christ, having been raised from the dead, dies no more. Death no longer has dominion over Him. 10 For the death that He died, He died to sin once for all; but the life that He lives, He lives to God. 11 Likewise you also, reckon yourselves to be dead indeed to sin, but alive to God in Christ Jesus our Lord.
12 Therefore do not let sin reign in your mortal body, that you should obey it in its lusts. 13 And do not present your members as instruments of unrighteousness to sin, but present yourselves to God as being alive from the dead, and your members as instruments of righteousness to God. 14 For sin shall not have dominion over you, for you are not under law but under grace.
And Galatians 3:22-28:
26 For you are all sons of God through faith in Christ Jesus. 27 For as many of you as were baptized into Christ have put on Christ. 28 There is neither Jew nor Greek, there is neither slave nor free, there is neither male nor female; for you are all one in Christ Jesus. 29 And if you
are Christ’s, then you are Abraham’s seed, and heirs according to the promise.
Through baptism, we are freed from sin and are clothed with Christ, being raised up to new life in Him.
Yes, there are exceptional cases where people receive the Holy Spirit outside of baptism. However, such cases are the exception, not the norm, and so it is better to be baptized than to gamble on the idea that you're still "covered." This is not to say that the unbaptized are damned, but to be fully initiated into the Christian life, why would you not be baptized, die to your old, sinful self, be cleansed of your sin, and begin your life anew in Christ?
Let me know if you want anything clarified or explained further