VS 2005 - Creating Array Of Custom Controls?

I am creating an array of customer controls by doing the following:
Dim CtlLosArray(150) As Control

Then I'm setting up the first control in the array like this:
CtlLosArray(1) = New ShieldLOSInfobox
CtlLosArray(1).Location = New Point(0, 0)
CtlLosArray(1).Visible = True
CtlLosArray(1).Show()
CtlLosArray(1).Name = "Label1"
Me.pnlLOS.Controls.Add(CtlLosArray(1))

Now on this custom control I have a panel and a few text boxes and as you can see I may be adding about 150 of these custom controls. What I am wanting to do is to be able to access that control then the item on that control based on the array. Something like the following:
CtlLosArray(1).Controls.Item(Panel1).backcolor = Color.Yellow
But the above does not work. How I can access a specific item on the customer control within the array?