I’ve a problem in indexing with Zend Search Lucene framework.<\/p>\n
Our file repository has ~25000 files and I’m trying to index them. But during batch indexing, this error occurred:<\/p>\n
\nNotice: \nUndefined offset: 2047 in \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentInfo.php on line 641 \nNotice: \nTrying to get property of non-object in \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentMerger.php on line 202 \nFatal error: \nUncaught exception 'Zend_Search_Lucene_Exception' with message 'Error occured while file reading.' in \/my\/Zend\/lib\/Search\/Lucene\/Storage\/File\/Filesystem.php:174 \nStack trace: \n#0 \/my\/Zend\/lib\/Search\/Lucene\/Storage\/File.php(470): Zend_Search_Lucene_Storage_File_Filesystem->_fread(524287) \n#1 \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentMerger.php(203): Zend_Search_Lucene_Storage_File->readBinary() \n#2 \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentMerger.php(126): Zend_Search_Lucene_Index_SegmentMerger->_mergeStoredFields() \n#3 \/my\/Zend\/lib\/Search\/Lucene\/Index\/Writer.php(385): Zend_Search_Lucene_Index_SegmentMerger->merge() \n#4 \/my\/Zend\/lib\/Search\/Lucene\/Index\/Writer.php(341): Zend_Search_Lucene_Index_Writer->_mergeSegments(Array) \n#5 \/my\/Zend\/lib\/Search\/Lucene\/Index\/Writer.php(250): Zend_Search_Lucene_Index_Writer->_maybeMergeSegments() \n#6 \/my\/Zend\/lib\/Search\/Luc in \/my\/Zend\/lib\/Search\/Lucene\/Storage\/File\/Filesystem.php on line 174 \n<\/pre>\nIt occured when my program index 1000th file.<\/p>\n
my code is here:<\/p>\n
(I send fileNames through an ajax code.)<\/p>\n
$handle = fopen('\/my\/index\/directory\/my.lock', 'w');\nif (flock($handle, LOCK_EX)){\n $mergeFactor = 300;\n $fileName = $_POST['fileName'];\n $index = Zend_Search_Lucene::open($path);\n $doc = new FileDocument($fileName,true);\n $similarity = new Search_Similarity();\n Zend_Search_Lucene_Search_Similarity::setDefault($similarity);\n Zend_Search_Lucene_Search_QueryParser::setDefaultEncoding('UTF-8');\n Zend_Search_Lucene_Analysis_Analyzer::setDefault(new Zend_Search_Lucene_Analysis_Analyzer_Common_Utf8_CaseInsensitive());\n $index->setMergeFactor($mergeFactor);\n \/\/if ($index->count() % 50 == 0){\n \/\/ $index->optimize();\n \/\/}\n $index->addDocument($doc);\n flock($handle, LOCK_UN);\n}else {\n echo \"UNABLE To Lock!\";\n}\nfclose($handle);\n<\/code><\/pre>\nMy Zend Version: 1.11.11<\/p>\n
and when I toggle comments to optimize my index manually, this error occured in another file:<\/p>\n
\nNotice: \nUndefined offset: 16383 in \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentInfo.php on line 641 \nNotice: \nTrying to get property of non-object in \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentMerger.php on line 202 \nFatal error: \nUncaught exception 'Zend_Search_Lucene_Exception' with message 'Error occured while file reading.' in \/my\/Zend\/lib\/Search\/Lucene\/Storage\/File\/Filesystem.php:174 \nStack trace: \n#0 \/my\/Zend\/lib\/Search\/Lucene\/Storage\/File.php(470): Zend_Search_Lucene_Storage_File_Filesystem->_fread(81919) \n#1 \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentMerger.php(203): Zend_Search_Lucene_Storage_File->readBinary() \n#2 \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentMerger.php(126): Zend_Search_Lucene_Index_SegmentMerger->_mergeStoredFields() \n#3 \/my\/Zend\/lib\/Search\/Lucene\/Index\/Writer.php(385): Zend_Search_Lucene_Index_SegmentMerger->merge() \n#4 \/my\/Zend\/lib\/Search\/Lucene\/Index\/Writer.php(807): Zend_Search_Lucene_Index_Writer->_mergeSegments(Array) \n#5 \/my\/Zend\/lib\/Search\/Lucene.php(1456): Zend_Search_Lucene_Index_Writer->optimize() \n#6 \/my\/Zend\/lib\/Search\/Lucene\/Proxy.php(518): Zend in \/my\/Zend\/lib\/Search\/Lucene\/Storage\/File\/Filesystem.php on line 174 \n<\/pre>\n\n
- \n
What’s my problem?!<\/p>\n<\/li>\n
- \n
What’s my solution?! \ud83d\ude00<\/p>\n<\/li>\n<\/ol>\n
Thanks. \ud83d\ude42<\/p>\n
\n
- \n
I have the same problem, but I have to add some lines of code in Zend Lucene, becauce couldn’t find solution. There are two checking on existing field, below:<\/p>\n
in file: Zend\/Search\/Lucene\/Index\/SegmentInfo.php<\/p>\n
public function getField($fieldNum)\n{\n if (isset($this->_fields[$fieldNum])) \/\/ add this line to check field in the fields array\n return $this->_fields[$fieldNum];\n}\n<\/code><\/pre>\nin file: Zend\/Search\/Lucene\/Index\/SegmentManager.php<\/p>\n
private function _mergeStoredFields()\n{\n \/\/..\n foreach ($this->_segmentInfos as $segName => $segmentInfo) {\n \/\/ ..\n for ($count = 0; $count < $segmentInfo->count(); $count++) {\n \/\/ ..\n for ($count2 = 0; $count2 < $fieldCount; $count2++) {\n \/\/ ..\n if (!$fieldInfo) \/\/ add this lines\n continue; \/\/ to exclude empty field\n }\n \/\/ ..\n }\n \/\/ ..\n }\n \/\/ ..\n}\n<\/code><\/pre>\nBetter late than never :)))<\/p>\n
UPD: hm.. unfortunately as I learn this code isn’t a solution \ud83d\ude41<\/h2>\n<\/li>\n<\/ol>\n
Originally posted 2013-11-09 23:40:14. <\/small><\/p>","protected":false},"excerpt":{"rendered":"
I’ve a problem in indexing with Zend Search Lucene framework. Our file repository has ~25000 files and I’m trying to index them. But during batch indexing, this error occurred: Notice: Undefined offset: 2047 in \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentInfo.php on line 641 Notice: Trying to get property of non-object in \/my\/Zend\/lib\/Search\/Lucene\/Index\/SegmentMerger.php on line 202 Fatal error: Uncaught exception ‘Zend_Search_Lucene_Exception’ […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,8],"tags":[],"class_list":["post-1191","post","type-post","status-publish","format-standard","hentry","category-uncategorized","category-zend-framework"],"_links":{"self":[{"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/posts\/1191","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/comments?post=1191"}],"version-history":[{"count":1,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/posts\/1191\/revisions"}],"predecessor-version":[{"id":8899,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/posts\/1191\/revisions\/8899"}],"wp:attachment":[{"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/media?parent=1191"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/categories?post=1191"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/unknownerror.org\/index.php\/wp-json\/wp\/v2\/tags?post=1191"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}