How can I assign a variable to all the cells in a column (of an excel sheet) using loop in python?

How can I initialize my column to 0 and the row between 1 and 1000000?

Then how should I assign a variable to data in each cell like a1, a2,a3.....a1000000.