Here, already from a young age, which ought to tell you something (enthusiasm dies hard):
I long ago rejected the notion that God is “infinite.” I rejected it when I first heard it articulated which was probably in some seminary class. I immediately thought that the concept itself was beyond comprehension (except perhaps in mathematics) and that attributing it to God led away from thinking of God as personal, present, involved, loving and able to be affected by us. With Brightman (who I only learned about later) I thought of that attribute of God in traditional theology as an inappropriate expansion of the concept of God brought into Christian thought through philosophy, not the Bible.
Compare the Athanasian Creed:
And the catholic faith is this: That we worship one God in Trinity, and Trinity in Unity; Neither confounding the Persons; nor dividing the Essence. For there is one Person of the Father; another of the Son; and another of the Holy Ghost. But the Godhead of the Father, of the Son, and of the Holy Ghost, is all one; the Glory equal, the Majesty coeternal. Such as the Father is; such is the Son; and such is the Holy Ghost. The Father uncreated; the Son uncreated; and the Holy Ghost uncreated. The Father unlimited; the Son unlimited; and the Holy Ghost unlimited. The Father eternal; the Son eternal; and the Holy Ghost eternal. And yet they are not three eternals; but one eternal. As also there are not three uncreated; nor three infinites, but one uncreated; and one infinite [et unus immensus].
Hilary of Poitiers, On the Councils (composed in 359), thought it was a mark of safety to employ expansion in theology in order to avoid error (unlike Olson), and that the profusion of definitions appropriately mimics the boundlessness of God:
The infinite and boundless [infinitus et immensus] God cannot be made comprehensible by a few words of human speech. Brevity often misleads both learner and teacher, and a concentrated discourse either causes a subject not to be understood, or spoils the meaning of an argument where a thing is hinted at, and is not proved by full demonstration. The bishops fully understood this, and therefore have used for the purpose of teaching many definitions and a profusion of words that the ordinary understanding might find no difficulty, but that their hearers might be saturated with the truth thus differently expressed, and that in treating of divine things these adequate and manifold definitions might leave no room for danger or obscurity.
The reductionism of the Reformation is a contrary tendency.
