Zend Fetch on large table 10,000 + rows, ~100 columns - php

Question

I have an sql view which returns over 10,000 records with about 120 columns (ridiculous, I know).
The view data is gathered from the database in PHP using a Zend_Db_Table_Abstract object. We have a report controller which does a fetchAll (which obviously creates a massive array) and stores the array in a view object. Next we have a view script which iterates over the array and echoes a json formatted array.
This is slowwww. Like over 1 minute to render this report, what can I do to speed this up?
Bare in mind I am very new to this project and have no knowledge of Zend and little of PHP. Also I can't give away to much due to data protection etc.
If you could ask what you need to help you gather the picture that would be great. But basically this is what the script does:
Report controller:
Setup some basic json report data (for data tables)
$this->view->report_data = fetchALL($oSelect);
View script:
Output the basic json stuff, then:
"report_data": [
<?php
for($i = 0; $i < count($this->report_data); $i++){
echo "[";
foreach($this->columns as $k=>$col){
echo '"'. $this->escape($this->report_data[$i][$col]) .'"';
if($k < count($this->columns) -1 ){
echo ',';
}
}
echo "]";
if($i < count($this->report_data) -1){
echo ",";
}
echo"\n";
}
?> ]
So after doing some research I gathered that I could use fetch() instead of fetchAll() so to get 1 row at a time, to avoid the massive array. However I tried to use the fetch() and got this error:
Call to undefined method Zend_Db_Table_Abstract::fetch()
So now I'm bummed.
My idea was to get each row and output each row Json formatted, however I don't really know how I would do this in the report controller/ view scenario. Would I have to just get rid of the view script and just use the controller to output the data?
Anyway why does fetch() not work, I can't actually see it in the docs either, well there is some array function _fetch()
Any help would be appreciated, any if you need more info just ask.
Thanks

Answer 1

See the docs for fetch().
The following is not very elegant, but could help you:
Model:
...
function getResults()
{
return $db->query('SELECT * FROM bugs');
}
...
Controller:
...
$this->view->report_data = $model->getResults();
...
View:
...
while ($row = $stmt->fetch(PDO::FETCH_OBJ)) {
echo Zend_Json::encode($row);
}
...
I haven't tested the code, but you should get the idea.

Answer 2

You have to improvise use of framework here to gain that extra bit of performance
In controller
$this->view->result = mysql_query($sql);
In view
while ($row = mysql_fetch_assoc($this->result)) {
echo json_encode($row);
}
Note to setup mysql procedure interface read
http://php.net/manual/en/function.mysql-fetch-assoc.php

Answer 3

As you have realised from the error message Zend_Db_Table_Abstract does not have a fetch() method. It does, however, have a fetchRow() method that has this signature:-
/**
* Fetches one row in an object of type Zend_Db_Table_Row_Abstract,
* or returns null if no row matches the specified criteria.
*
* #param string|array|Zend_Db_Table_Select $where OPTIONAL An SQL WHERE clause or Zend_Db_Table_Select object.
* #param string|array $order OPTIONAL An SQL ORDER clause.
* #param int $offset OPTIONAL An SQL OFFSET value.
* #return Zend_Db_Table_Row_Abstract|null The row results per the
* Zend_Db_Adapter fetch mode, or null if no row found.
*/
public function fetchRow($where = null, $order = null, $offset = null)
So replacing fetch() with fetchRow() and looping while !null === fetchRow() should work for you.
It is always worth delving into the code of Zend Framework to see what is on offer.
Zend Paginator may also be an option for you as it just fetches the records required to render the page.