import a large number of listings to wordpress directory

I have about 600k listings data on a csv. There are about 4 images for each listing. They need to be imported onto wordpress website. I have a powerful server and so far i have imported about 100K listings using wpallimport cronjobs. It got quite slow (6 listings per minute), so i wanted to improve this speed. The server is centos with whm.