ManifoldCF Change Log $Id: CHANGES.txt 1167112 2011-09-09 11:42:42Z kwright $ ======================= Release 0.3 ========================= CONNECTORS-240: Add OpenSearchServer end-user documentation. (Emmanuel Keller, Karl Wright) CONNECTORS-250: Renew jcifs download site link. (Shinichiro Abe) CONNECTORS-253: Make script output of configurationnode script object have attributes that are ordered, so the test does not depend on hash order. (Shinichiro Abe, Karl Wright) CONNECTORS-246, CONNECTORS-248, CONNECTORS-249: Problems with MVCC model of Hsqldb causing query inconsistencies, fixed in HSQLDB 2.2.5-6-9-2011. (Fred Toussi, Karl Wright) CONNECTORS-247: Add unit tests for script engine. (Karl Wright) CONNECTORS-144: Remove Apache license from DISCLAIMER.txt, as per the incubator's instructions. (Karl Wright) CONNECTORS-177: Remove test code from file system connector. (Karl Wright) CONNECTORS-141: Exclude files from rat report that the Forrest teams says I should. (Karl Wright) CONNECTORS-58: Add client scripting language and a file-system-based example. (Karl Wright) CONNECTORS-245: Fix API bug where schedule JSON was incorrect when fetching job description. (Karl Wright) CONNECTORS-229: CMIS connector needs to be documented in "how to build and deploy" (Piergiorgio Lucidi) CONNECTORS-244: Add a fix to recover for another Derby deadlock situation. (Karl Wright) CONNECTORS-243: Include most response headers in the metadata for each web connector document. (Jan Høydahl, Karl Wright) CONNECTORS-224: Add OpenSearchServer output connector. (Emmanuel Keller, Karl Wright) CONNECTORS-157: Fixed a second kind of case where the java.net.URI class is broken. Relative queries starting with "?" now replace the query part of the url. (David Broadfoot, Karl Wright) CONNECTORS-239: RSS connector chromed content mode was broken. (Kate McGonigal, Karl Wright) CONNECTORS-238: Hard errors from notification output connector method should be noted and then ignored. (Karl Wright) CONNECTORS-61: Make it easy (and document) how to integrate ManifoldCF into an application. (Karl Wright) CONNECTORS-226: Clean up usage of REPOSITORY_CONNECTION_ERROR ManifoldCFException type. (Karl Wright) CONNECTORS-236: Add tests for CMIS connector. (Piergiorgio Lucidi, Karl Wright) CONNECTORS-234: Add support for CMIS binding protocol. (Piergiorgio Lucidi, Karl Wright) CONNECTORS-235: Fix broken Derby and HSQLDB file-based carrydown data, and added the ability to handle RSS feed description values outside of dechromed content. (Kate McGonigal, Karl Wright) CONNECTORS-232: Fix site icon link. (Piergiorgio Lucidi, Karl Wright) CONNECTORS-230: Add CMIS mention to the ManifoldCF documentation. (Karl Wright) CONNECTORS-228: Add maven support for CMIS connector. (Piergiorgio Lucidi, Karl Wright) CONNECTORS-231: Missing dependency in pom.xml. (Piergiorgio Lucidi) CONNECTORS-227: Fix the error reporting so it includes the problem message. (Piergiorgio Lucidi) CONNECTORS-221: Add CMIS connector. (Piergiorgio Lucidi, Karl Wright) CONNECTORS-214: Add post-fetch regular expression filtering to Web connector. (Karl Wright) CONNECTORS-225: Derby throws deadlock exceptions when indexing rapidly. (Karl Wright) CONNECTORS-223: Move test classes to be compatible with maven conventions. (Tobias Rübner, Karl Wright) CONNECTORS-219: Update maven pom.xml files to include proper dependencies and version numbers. (Tobias Rübner) CONNECTORS-220: Fix long-standing issue with database connection problems. Reset logic was insufficiently robust. (Farzad Valad, Karl Wright) CONNECTORS-217: Check running more than one of instance of agent. (Shinichiro Abe) CONNECTORS-218: LockClean supports relative path to the synchronization directory. (Shinichiro Abe) CONNECTORS-215: Setting an environment variable of agent. Add options.env file, in which we can define optional value. (Karl Wright, Shinichiro Abe) CONNECTORS-216: Clean up document removal options in IProcessActivity, and modify connectors accordingly to avoid using the deprecated form of deleteDocument(). (Karl Wright) CONNECTORS-214: Add output connector support for restricting documents based on mime type, URL, and document length. Hook this up to the web and RSS connectors, and add mime type and maximum length fields to the Solr connector. (Erlend Garåsen, Karl Wright) CONNECTORS-212: Failure during notify should send job back to ReadyForNotify state, not ReadyForDelete state. (Karl Wright) CONNECTORS-211: Move pack() and unpack() utility methods into the connector base class. (Karl Wright) CONNECTORS-210: Handle RuntimeException exceptions better in connector factories. (Farzad Valad, Karl Wright) CONNECTORS-208: Make support for metadata Reader objects really work. (Karl Wright) CONNECTORS-204: Add an HSQLDB set of test targets, which use that database. (Karl Wright) CONNECTORS-206: Document HSQLDB properties, and mention it as a supported choice in the documentation. (Karl Wright) CONNECTORS-114: Finish HSQLDB implementation. (Fred Toussi, Karl Wright) CONNECTORS-205: Changed the database interface distinct-on abstraction to also include the order-by clause, so we can write something that will work for HSQLDB. (Karl Wright) CONNECTORS-203: Move to Java 1.5 compilation and conventions. (Erlend Garåsen, Tommaso Teofili, Karl Wright et al) CONNECTORS-201: Add activity interface ICarrydownActivity to allow sharing of functionality across IVersionActivity and IProcessActivity. (Karl Wright) CONNECTORS-200: Interpret TikaExceptions as being permanent failures. (Erlend Garåsen, Shinichiro Abe, Karl Wright) CONNECTORS-199: Modify site to point to new 0.2-incubating release. (Karl Wright) CONNECTORS-197: Add a switch that allows user to select which AD attribute to use for login name. (Shinichiro Abe, Karl Wright) CONNECTORS-198: Update rat-sources ant target to exclude test-output-postgresql folders. (Karl Wright) CONNECTORS-174: The standard logging.ini file for the Quick Start should set a log format that includes at least date and time. (Erlend Garåsen, Karl Wright) CONNECTORS-194: Forrest doc build always gets an error because of relative references to javadoc roots. (Erlend Garåsen, Karl Wright) CONNECTORS-196: Active directory authority did not work if login name and common name differed. (Kadri Atalay, Shinichiro Abe, Karl Wright) CONNECTORS-195: Active directory authority does not properly identify non-existing users on all versions of Java and all versions of AD. (Kadri Atalay, Karl Wright) CONNECTORS-192: Specification processing would sometimes be called without the specification data being posted. (Karl Wright) CONNECTORS-191: Fix eol-style attribute for .bat files to always be CRLF. (Karl Wright) CONNECTORS-190: Fix busted link to JSON stuff. (Karl Wright) CONNECTORS-189: Added links to directly access the group distribution email archives. (Farzad Valad) Update the site to create a direct link to the book, and also bring the copyrights and breadcrumbs to the current era. (Karl Wright) CONNECTORS-185: Clarify the build-and-deploy document to make sure it is clear that the configfile define is needed for the application server. (Mark Moloney, Karl Wright) CONNECTORS-186: Refactor WorkerThread code to permit all output connector methods to throw a ServiceInterruption, including the getOutputDescription() method. (Karl Wright) CONNECTORS-183: Add a text field to make Active Directory authority configuration more flexible with regards to protocol. (Shinichiro Abe, Karl Wright) CONNECTORS-32: Add access token caching to the Active Directory authority connector, LiveLink authority connector, Meridio authority connector, and Documentum authority connector. (Shinichiro Abe, Karl Wright) CONNECTORS-182: Install timed expiration of cached objects, which was not hooked up to the idle cleanup architecture. (Karl Wright) CONNECTORS-181: Fix the way timed expiration works to agree with the description, and pass in a current time parameter to make it work readily for continuous renewal. (Karl Wright) CONNECTORS-179: Add ability to throw ManifoldCFException from the IConnector method setThreadContext. (Karl Wright) CONNECTORS-175: Update documentation of properties.xml parameters to include missing ones. (Shinichiro Abe, Karl Wright) CONNECTORS-173: Update javadoc to include table schemas. (Shinichiro Abe) CONNECTORS-171: Make sure XML output from within XML document does not corrupt entity references. (Fuad Efendi) ======================= Release 0.2 ======================= Release Date: See http://incubator.apache.org/connectors for the official release date. CONNECTORS-188: Change the eol-style attribute to LF for all the .sh files. (Erlend Garåsen, Karl Wright) Web site updated to reflect proposed release. CONNECTORS-172: At the advice of the Derby team, build Derby in "insane" mode to allow it to recover from internal errors. (Koji Sekiguchi, Karl Wright) CONNECTORS-170: Add support to the Derby driver for periodic analysis and reindexing, since after 10.7.1.1 it seems this is now supported. (Karl Wright) CONNECTORS-169: Add a method to the database abstraction to return the maximum number of OR clauses in a query. This is to make Derby efficient, since it can't seem to use indexes in this situation (Karl Wright) CONNECTORS-166: Pull a Derby fix down from trunk into Derby 10.7.1.1, to fix deadlock problems (Oleg Tikhonov, Karl Wright) CONNECTORS-168: Change error reporting logic in Solr connector to handle non-XML responses (Fuad Efendi, Karl Wright) CONNECTORS-159: Add support for external PostgreSQL server (Erlend Garåsen, Karl Wright) CONNECTORS-165: Upgrade to jetty 6.1.26, plus patches, which is what Solr is using. (Robert Muir, Karl Wright) CONNECTORS-163: Use Derby 10.7.1.1. (Oleg Tikhonov, Karl Wright) CONNECTORS-162: Add infrastructure support for derived resource loading, so that individual connectors can use this model to prevent jar conflicts. (Karl Wright) CONNECTORS-160: Add local trust store and working https support for Solr connector. (Carina Lannig, Karl Wright) CONNECTORS-151: Add folder support to FileNet connector. (Oleg Tikhonov, Karl Wright) CONNECTORS-157: Web crawler url resolution was broken for relative paths, because the way java.net.URI resolved them changed. (Karl Wright) CONNECTORS-156: Update site to describe work-around instructions. (Karl Wright) CONNECTORS-154: Add an ant target, and tests, that work against the postgresql database. (Karl Wright) CONNECTORS-155: Fix a query bug with fetching the job status of a single, specified job. (Karl Wright) CONNECTORS-148: Intermittent failures creating the PostgreSQL database still occurring; traced the problem this time to PostgreSQL not accepting a parameter for the password when creating a user. (Nicolas Max, Karl Wright) CONNECTORS-153: Add support for robots meta tag to web connector. (Erlend Garåsen, Karl Wright) CONNECTORS-152: Refactor notification thread and states to make the framework more resilient. (Karl Wright) CONNECTORS-145: Refactor cleanup worker threads, expire threads, and document delete threads to handle failure of the output connection gracefully. (Karl Wright) CONNECTORS-130: Block the Solr output connector from accepting documents that have folder-level security. (Karl Wright) CONNECTORS-129: Add an API reset/outputconnections/xxx command, to forget the index state for an output connection. (Karl Wright) ======================= Release 0.1 ======================= Release Date: See http://incubator.apache.org/connectors for the official release date. CONNECTORS-149: Expire threads did not obey rules as far as deleting documents belonging to other jobs. Also, the test for whether a document was shared between jobs did not take the output connection into account. Finally, I found an infinite loop in the job delete stuffer thread code. (Karl Wright) CONNECTORS-147: Disable PDF's everywhere except for user documentation. (Grant Ingersoll, David Crossley, Karl Wright) CONNECTORS-148: Creating the database in PostgreSQL failed intermittently when a parameter was used for the encoding; the PostgreSQL documentation specifies that it must be a quoted string in that case. (Karl Wright) CONNECTORS-146: Problem with document cleanup logic would cause data corruption in carrydown data and in hopcount information. (Karl Wright) CONNECTORS-143: Copyright notice needs to be changed to 2011. (Sebb, Karl Wright) CONNECTORS-142: License and notice file revisions. (Ant Elder, Sebb, Ralph Goers, Karl Wright) CONNECTORS-140: Change build to generate both a -src and a -bin distribution. (Grant Ingersoll, Karl Wright) CONNECTORS-139: Change download area to www.apache.org/dist/incubator/manifoldcf, as according to incubator rules. (Karl Wright) CONNECTORS-138: Change name of release from 0.1-incubator to 0.1-incubating, as according to incubator rules. (Various) CONNECTORS-137: Add ASF headers to the jakarta standard tag library tld's that the crawler-ui uses. RAT detected these as a problem, and I have confirmed that they have an Apache origin. (Sebb, Karl Wright) CONNECTORS-132: Remove build artifacts from the archives, except for documentation. This is to save space. (Karl Wright) CONNECTORS-136: Change rat-sources build target to exclude all files known good despite RAT complaints. (Sebb, Karl Wright) CONNECTORS-135: Adjust svn properties of files to be consistent with intended usage. (Sebb) CONNECTORS-134: Put README.txt files in all empty directories that are meant for a user to supply third-party content. This prevents the archive from not delivering an empty directory. (Ant Elder, Sebb, Karl Wright) CONNECTORS-133: Update README.txt to include incubator disclaimer. (Ant Elder, Sebb, Karl Wright) CONNECTORS-131: Create download page with separate references for KEYS, CHANGES.txt, signatures, and artifacts. (Chris Mattmann, Karl Wright) CONNECTORS-128: Remove sql quoting logic to make sql injection attacks less possible. (Grant Ingersoll, Robert Muir, Karl Wright) CONNECTORS-122: FileNet and Documentum connector-specific process scripts needed. (Oleg Tikhonov, Karl Wright) CONNECTORS-127: Broken FileNet Document Classes tab. (Oleg Tikhonov, Karl Wright) CONNECTORS-126: Added a performance tuning page to the site. (Farzad, Karl Wright) Removed modules level of tree, and revamped build.xml in anticipation of a release. (Karl Wright) CONNECTORS-125: Set the default max handles property to be consistent with a default PostgreSQL installation. (Farzad, Karl Wright) CONNECTORS-124: Add a null authority connector, so authority tests can be written. (Karl Wright) CONNECTORS-109: Hooked up user-defined functions in Derby to perform the needed regular expression matching and grouping. (Karl Wright) CONNECTORS-121: Fixed broken javascript in the Windows Share connector "insert here" button. (Fred Schmitt, Karl Wright) CONNECTORS-117: Revised manner by which dynamic table maintenance is performed, so that it can be controlled by configuration parameters. (Farzad, Karl Wright) CONNECTORS-116: Removed Memex connector due to intellectual property concerns. (Robert Muir) CONNECTORS-113: Add properties that allow quick-start example to work properly with PostgreSQL. (Farzad, Karl Wright) Name change to ManifoldCF (Community) CONNECTORS-107: Entering report forms now preselects all activities. (Karl Wright) CONNECTORS-106: noteJobCompleted() method in IOutputConnector now receives an activities object, so activities can be recorded. (Karl Wright) CONNECTORS-98: Convert the API into a RESTful implementation. (Jack Krupansky, Mark Miller, Karl Wright) CONNECTORS-104: Add convenience feature to web connector to limit hosts to those explicitly mentioned in seeds. (Jack Krupansky, Karl Wright) CONNECTORS-102: Web connector default throttling settings. (Karl Wright) CONNECTORS-103: RSS connector default throttling settings. (Karl Wright) CONNECTORS-105: File system connector UI enhancements, to use a table-based metaphor for paths and rules. (Karl Wright) CONNECTORS-101: File system connector paths should automatically get default rules added. (Karl Wright) CONNECTORS-57: Add support in Solr connector for selecting whether end-of-job commits take place, on a per-connection basis. (Jack Krupansky, Karl Wright) CONNECTORS-41: Add support in the framework for end-of-job notification to the associated output connector, which can take an extended period of time. (Jack Krupansky, Karl Wright) CONNECTORS-97: Web connector session authentication was failing for some sites due to cookies httpclient thought were illegal, but browsers would accept. (Karl Wright) CONNECTORS-91: Made the initialization commands more accessible via code. (Jettro Coenradie, Karl Wright) CONNECTORS-90: Fixed a localization issue where database errors that should be soft errors were instead interpreted as hard failures for non-English locales. (Carina , Marc Emery, Karl Wright) CONNECTORS-62: Added additional LCF API Documentation (Karl Wright) CONNECTORS-59: Packaged application so that it is ready to run with embedded Jetty App Server. (Jack Krupansky, Karl Wright) CONNECTORS-56: Enhanced API so that more features are accessible programmatically. (Jack Krupansky, Karl Wright) CONNECTORS-52: Updated documentation to reflect new features added to the Solr connector. (Karl Wright) CONNECTORS-51: Reduce the number of required system properties needed to run the JCIFS connector. (Karl Wright) CONNECTORS-49: Allow mapping of the metadata ID field in the Solr connector. (Rohan G Patil, Jack Krupansky, Erik Hatcher, Karl Wright) CONNECTORS-48: Improve rules description for the SharePoint connector. (Karl Wright) CONNECTORS-47: Framework UI called connector post-processing more than needed. (Karl Wright) CONNECTORS-46: Improve documentation for metadata with the JDBC Connector. (Rohan G Patil, Karl Wright) CONNECTORS-45: Allow specifying the Solr core name with the Solr Connector. (Jack Krupansky, Erik Hatcher, Karl Wright) CONNECTORS-44: Add metadata support to the JDBC Connector. (Rohan G Patil, Karl Wright) CONNECTORS-43: Wseless call to String.trim in MultiLineParser (Mark Miller, Karl Wright) CONNECTORS-42: Impossible cast in org.apache.lcf.core.database.Database (Mark Miller, Karl Wright) CONNECTORS-40: Change to a classloader-based plugin architecture (Jack Krupansky, Mark Miller, Erik Hatcher, Karl Wright) CONNECTORS-39: Allow abstraction of database transaction management. (Karl Wright) CONNECTORS-38: Add a jetty-based "quick-start". (Jack Krupansky, Karl Wright) CONNECTORS-37: Switch to an XML configuration file. (Erik Hatcher, Jack Krupansky, Karl Wright) CONNECTORS-36: Improve the Solr Connector's UI to be more intuitive. (Karl Wright) CONNECTORS-35: Add a method to reset the framework. (Karl Wright) CONNECTORS-33: Document how to use the framework programmatically. (Karl Wright) CONNECTORS-26: Rename war files from "tomcat" to "web" as there is nothing tomcat-specific about them. (Erik Hatcher, Karl Wright) CONNECTORS-23: Add usage examples to Command documentation (Damien Mabin, Karl Wright) CONNECTORS-22: Add support for ACLs to the Solr Connector. (Dominique Bejean, Peter Sturge, Karl Wright) CONNECTORS-20, CONNECTORS-3: Add an ant build system. (Karl Wright) CONNECTORS-18: The Lucene Connector was renamed to Solr Connector. (Karl Wright) CONNECTORS-17: Fix broken link in the Crawler UI's help page. (Karl Wright) CONNECTORS-16: Generalize JCIFS connector's fingerprinting. (Sami Siren, Karl Wright) CONNECTORS-14: Remove some javac warnings. (Robert Muir, Karl Wright) CONNECTORS-12: Improve whitespace formatting to be consistent. (Erik Hatcher, Karl Wright) CONNECTORS-11: Add automated build for the Apache2 Module. (Karl Wright) CONNECTORS-9, CONNECTORS-8, CONNECTORS-7, CONNECTORS-5, CONNECTORS-2: Remove Metacarta branding and setup. (Karl Wright) CONNECTORS-6: Move documentation from LaTeX to the wiki. (Karl Wright) CONNECTORS-4: Submit changes to other packages as patches. (Oleg Kalnichevski, Karl Wright) CONNECTORS-1: Created connectors website. (Grant Ingersoll)