PHP out of memory with CDataProviderIterator (Yii) - php

Question

I am having an out of memory issue with my PHP script on the Yii framework. I've tried to do quite a bit of debugging. I'm using a CDataProviderIterator because the Yii documentation says this about it:
For example, the following code will iterate over all registered users (active record class User) without running out of memory, even if there are millions of users in the database.
This code iterates over around 1.5 million records and it runs out of memory in its attempt. I'm looking for any kind of help of why it might be doing this. Thanks!
public function foo($model, $relations) {
$dataProvider = new CActiveDataProvider($model, array('criteria' => $model->dbCriteria));
$iterator = new CDataProviderIterator($dataProvider, 200);
$this->modelsToArray($iterator, $relations, $model_as_array = array());
}
public function modelsToArray($model, $relations, $model_as_array = array()) {
$preparedRelations = $this->prepareRelations($relations);
if (is_null($model))
{
return array();
}
$model_as_array = array();
if (get_class($model) === 'CDataProviderIterator') {
foreach ($model as $row) {
$model_as_array[] = $this->modelsToArrayHelper($preparedRelations, $row);
}
}
else {
$model_as_array[] = $this->modelsToArrayHelper($preparedRelations, $model);
}
return $model_as_array;
}
private function modelsToArrayHelper($relations, $listOfModels) {
$listOfArrayModels = array();
if(!is_array($listOfModels)){
return $this->modelToArrayHelper($listOfModels, $relations);
}
foreach ($listOfModels as $index => $model)
{
$listOfArrayModels[$index] = $this->modelToArrayHelper($model, $relations);
}
return $listOfArrayModels;
}
private function modelToArrayHelper($model, $relations){
$model_as_array = $this->processAttributes($model);
foreach ($relations as $relationIndex => $relation)
{
$relationName = is_string($relationIndex) ? $relationIndex : $relation;
if(empty($model->$relationName))
continue;
if ($model->relations()[$relationName][0] != CActiveRecord::STAT)
{
$subRelations = is_array($relation) ? $relation : array();
$model_as_array[$relationName] = $this->modelsToArrayHelper($subRelations, $model->$relationName);
}
else
{
$model_as_array[$relationName] = $model->$relationName;
}
}
return $model_as_array;
}

Answer 1

i believe you are trying to convert the CDataProviderIterator to a Php array.
so for placing the array you need more memory
ini_set('memory_limit', '-1');
this sets the use of ram to max usage
ini_set('memory_limit', '512M');
this sets the ram usage to 512 Mb
Can you make your code like this just to make sure you are not using too much ram
public function foo($model, $relations) {
$dataProvider = new CActiveDataProvider($model, array('criteria' => $model->dbCriteria));
$iterator = new CDataProviderIterator($dataProvider, 200);
$preparedRelations = $this->prepareRelations($relations);
foreach ($iterator as $row) {
print_r ($this->modelsToArrayHelper($preparedRelations, $row));
}
}
and