Release: 1.3.0b1 beta release | Release Date: November 16, 2018

SQLAlchemy 1.3 Documentation

1.3 Changelog

1.3.0b2

no release date

orm

  • [orm] [bug] Extended the fix first made as part of #3287, where a loader option made against a subclass using a wildcard would extend itself to include application of the wildcard to attributes on the super classes as well, to a “bound” loader option as well, e.g. in an expression like Load(SomeSubClass).load_only('foo'). Columns that are part of the parent class of SomeSubClass will also be excluded in the same way as if the unbound option load_only('foo') were used.

    References: #4373

orm declarative

  • [orm declarative] [bug] Added a __clause_element__() method to ColumnProperty which can allow the usage of a not-fully-declared column or deferred attribute in a declarative mapped class slightly more friendly when it’s used in a constraint or other column-oriented scenario within the class declaration, though this still can’t work in open-ended expressions; prefer to call the ColumnProperty.expression attribute if receiving TypeError.

    References: #4372

sql

  • [sql] [feature] Amended the AnsiFunction class, the base of common SQL functions like CURRENT_TIMESTAMP, to accept positional arguments like a regular ad-hoc function. This to suit the case that many of these functions on specific backends accept arguments such as “fractional seconds” precision and such. If the function is created with arguments, it renders the the parenthesis and the arguments. If no arguents are present, the compiler generates the non-parenthesized form.

    References: #4386

misc

  • [bug] [ext] Fixed a regression in 1.3.0b1 caused by #3423 where association proxy objects that access an attribute that’s only present on a polymorphic subclass would raise an AttributeError even though the actual instance being accessed was an instance of that subclass.

    References: #4401

1.3.0b1

Released: November 16, 2018

orm

  • [orm] [feature] Added new feature Query.only_return_tuples(). Causes the Query object to return keyed tuple objects unconditionally even if the query is against a single entity. Pull request courtesy Eric Atkin.

    This change is also backported to: 1.2.5

  • [orm] [feature] Added new flag Session.bulk_save_objects.preserve_order to the Session.bulk_save_objects() method, which defaults to True. When set to False, the given mappings will be grouped into inserts and updates per each object type, to allow for greater opportunities to batch common operations together. Pull request courtesy Alessandro Cucci.

  • [orm] [feature] The “selectin” loader strategy now omits the JOIN in the case of a simple one-to-many load, where it instead relies loads only from the related table, relying upon the foreign key columns of the related table in order to match up to primary keys in the parent table. This optimization can be disabled by setting the relationship.omit_join flag to False. Many thanks to Jayson Reis for the efforts on this.

    References: #4340

  • [orm] [feature] Added .info dictionary to the InstanceState class, the object that comes from calling inspect() on a mapped object.

    References: #4257

  • [orm] [bug] Fixed bug where use of Lateral construct in conjunction with Query.join() as well as Query.select_entity_from() would not apply clause adaption to the right side of the join. “lateral” introduces the use case of the right side of a join being correlatable. Previously, adaptation of this clause wasn’t considered. Note that in 1.2 only, a selectable introduced by Query.subquery() is still not adapted due to #4304; the selectable needs to be produced by the select() function to be the right side of the “lateral” join.

    This change is also backported to: 1.2.12

    References: #4334

  • [orm] [bug] Fixed issue regarding passive_deletes=”all”, where the foreign key attribute of an object is maintained with its value even after the object is removed from its parent collection. Previously, the unit of work would set this to NULL even though passive_deletes indicated it should not be modified.

    References: #3844

  • [orm] [bug] Improved the behavior of a relationship-bound many-to-one object expression such that the retrieval of column values on the related object are now resilient against the object being detached from its parent Session, even if the attribute has been expired. New features within the InstanceState are used to memoize the last known value of a particular column attribute before its expired, so that the expression can still evaluate when the object is detached and expired at the same time. Error conditions are also improved using modern attribute state features to produce more specific messages as needed.

    References: #4359

  • [orm] [bug] [mysql] [postgresql] The ORM now doubles the “FOR UPDATE” clause within the subquery that renders in conjunction with joined eager loading in some cases, as it has been observed that MySQL does not lock the rows from a subquery. This means the query renders with two FOR UPDATE clauses; note that on some backends such as Oracle, FOR UPDATE clauses on subqueries are silently ignored since they are unnecessary. Additionally, in the case of the “OF” clause used primarily with Postgresql, the FOR UPDATE is rendered only on the inner subquery when this is used so that the selectable can be targeted to the table within the SELECT statement.

    References: #4246

  • [orm] [bug] Refactored Query.join() to further clarify the individual components of structuring the join. This refactor adds the ability for Query.join() to determine the most appropriate “left” side of the join when there is more than one element in the FROM list or the query is against multiple entities. If more than one FROM/entity matches, an error is raised that asks for an ON clause to be specified to resolve the ambiguity. In particular this targets the regression we saw in #4363 but is also of general use. The codepaths within Query.join() are now easier to follow and the error cases are decided more specifically at an earlier point in the operation.

    References: #4365

  • [orm] [bug] Fixed long-standing issue in Query where a scalar subquery such as produced by Query.exists(), Query.as_scalar() and other derivations from Query.statement would not correctly be adapted when used in a new Query that required entity adaptation, such as when the query were turned into a union, or a from_self(), etc. The change removes the “no adaptation” annotation from the select() object produced by the Query.statement accessor.

    References: #4304

  • [orm] [bug] An informative exception is re-raised when a primary key value is not sortable in Python during an ORM flush under Python 3, such as an Enum that has no __lt__() method; normally Python 3 raises a TypeError in this case. The flush process sorts persistent objects by primary key in Python so the values must be sortable.

    References: #4232

  • [orm] [bug] Removed the collection converter used by the MappedCollection class. This converter was used only to assert that the incoming dictionary keys matched that of their corresponding objects, and only during a bulk set operation. The converter can interfere with a custom validator or AttributeEvents.bulk_replace() listener that wants to convert incoming values further. The TypeError which would be raised by this converter when an incoming key didn’t match the value is removed; incoming values during a bulk assignment will be keyed to their value-generated key, and not the key that’s explicitly present in the dictionary.

    Overall, @converter is superseded by the AttributeEvents.bulk_replace() event handler added as part of #3896.

    References: #3604

  • [orm] [bug] Added new behavior to the lazy load that takes place when the “old” value of a many-to-one is retrieved, such that exceptions which would be raised due to either lazy="raise" or a detached session error are skipped.

    References: #4353

  • [orm] [bug] A long-standing oversight in the ORM, the __delete__ method for a many- to-one relationship was non-functional, e.g. for an operation such as del a.b. This is now implemented and is equivalent to setting the attribute to None.

    References: #4354

orm declarative

  • [bug] [declarative] [orm] Fixed bug where declarative would not update the state of the Mapper as far as what attributes were present, when additional attributes were added or removed after the mapper attribute collections had already been called and memoized. Addtionally, a NotImplementedError is now raised if a fully mapped attribute (e.g. column, relationship, etc.) is deleted from a class that is currently mapped, since the mapper will not function correctly if the attribute has been removed.

    References: #4133

engine

  • [engine] [feature] Added new “lifo” mode to QueuePool, typically enabled by setting the flag create_engine.pool_use_lifo to True. “lifo” mode means the same connection just checked in will be the first to be checked out again, allowing excess connections to be cleaned up from the server side during periods of the pool being only partially utilized. Pull request courtesy Taem Park.

sql

  • [sql] [feature] Refactored SQLCompiler to expose a SQLCompiler.group_by_clause() method similar to the SQLCompiler.order_by_clause() and SQLCompiler.limit_clause() methods, which can be overridden by dialects to customize how GROUP BY renders. Pull request courtesy Samuel Chou.

    This change is also backported to: 1.2.13

  • [sql] [feature] Added Sequence to the “string SQL” system that will render a meaningful string expression ("<next sequence value: my_sequence>") when stringifying without a dialect a statement that includes a “sequence nextvalue” expression, rather than raising a compilation error.

    References: #4144

  • [sql] [feature] Added new naming convention tokens column_0N_name, column_0_N_name, etc., which will render the names / keys / labels for all columns referenced by a particular constraint in a sequence. In order to accommodate for the length of such a naming convention, the SQL compiler’s auto-truncation feature now applies itself to constraint names as well, which creates a shortened, deterministically generated name for the constraint that will apply to a target backend without going over the character limit of that backend.

    The change also repairs two other issues. One is that the column_0_key token wasn’t available even though this token was documented, the other was that the referred_column_0_name token would inadvertently render the .key and not the .name of the column if these two values were different.

    References: #3989

  • [sql] [feature] Added new logic to the “expanding IN” bound parameter feature whereby if the given list is empty, a special “empty set” expression that is specific to different backends is generated, thus allowing IN expressions to be fully dynamic including empty IN expressions.

    References: #4271

  • [sql] [feature] The Python builtin dir() is now supported for a SQLAlchemy “properties” object, such as that of a Core columns collection (e.g. .c), mapper.attrs, etc. Allows iPython autocompletion to work as well. Pull request courtesy Uwe Korn.

  • [sql] [feature] Added new feature FunctionElement.as_comparison() which allows a SQL function to act as a binary comparison operation that can work within the ORM.

    References: #3831

  • [sql] [bug] Added “like” based operators as “comparison” operators, including ColumnOperators.startswith() ColumnOperators.endswith() ColumnOperators.ilike() ColumnOperators.notilike() among many others, so that all of these operators can be the basis for an ORM “primaryjoin” condition.

    References: #4302

  • [sql] [bug] Fixed issue with TypeEngine.bind_expression() and TypeEngine.column_expression() methods where these methods would not work if the target type were part of a Variant, or other target type of a TypeDecorator. Additionally, the SQL compiler now calls upon the dialect-level implementation when it renders these methods so that dialects can now provide for SQL-level processing for built-in types.

    References: #3981

postgresql

  • [postgresql] [feature] Added new PG type postgresql.REGCLASS which assists in casting table names to OID values. Pull request courtesy Sebastian Bank.

    This change is also backported to: 1.2.7

    References: #4160

  • [postgresql] [feature] Added rudimental support for reflection of Postgresql partitioned tables, e.g. that relkind=’p’ is added to reflection queries that return table information.

    References: #4237

mysql

  • [mysql] [feature] Support added for the “WITH PARSER” syntax of CREATE FULLTEXT INDEX in MySQL, using the mysql_with_parser keyword argument. Reflection is also supported, which accommodates MySQL’s special comment format for reporting on this option as well. Additionally, the “FULLTEXT” and “SPATIAL” index prefixes are now reflected back into the mysql_prefix index option.

    References: #4219

  • [mysql] [feature] Added support for the parameters in an ON DUPLICATE KEY UPDATE statement on MySQL to be ordered, since parameter order in a MySQL UPDATE clause is significant, in a similar manner as that described at Parameter-Ordered Updates. Pull request courtesy Maxim Bublis.

  • [mysql] [feature] The “pre-ping” feature of the connection pool now uses the ping() method of the DBAPI connection in the case of mysqlclient, PyMySQL and mysql-connector-python. Pull request courtesy Maxim Bublis.

sqlite

  • [sqlite] [feature] Added support for SQLite’s json functionality via the new SQLite implementation for types.JSON, sqlite.JSON. The name used for the type is JSON, following an example found at SQLite’s own documentation. Pull request courtesy Ilja Everilä.

    References: #3850

  • [sqlite] [feature] Implemented the SQLite ON CONFLICT clause as understood at the DDL level, e.g. for primary key, unique, and CHECK constraints as well as specified on a Column to satisfy inline primary key and NOT NULL. Pull request courtesy Denis Kataev.

    References: #4360

mssql

oracle

  • [oracle] [feature] Added a new event currently used only by the cx_Oracle dialect, DialectEvents.setiputsizes(). The event passes a dictionary of BindParameter objects to DBAPI-specific type objects that will be passed, after conversion to parameter names, to the cx_Oracle cursor.setinputsizes() method. This allows both visibility into the setinputsizes process as well as the ability to alter the behavior of what datatypes are passed to this method.

    This change is also backported to: 1.2.9

    References: #4290

  • [oracle] [bug] Updated the parameters that can be sent to the cx_Oracle DBAPI to both allow for all current parameters as well as for future parameters not added yet. In addition, removed unused parameters that were deprecated in version 1.2, and additionally we are now defaulting “threaded” to False.

    References: #4369

  • [oracle] [bug] The Oracle dialect will no longer use the NCHAR/NCLOB datatypes represent generic unicode strings or clob fields in conjunction with Unicode and UnicodeText unless the flag use_nchar_for_unicode=True is passed to create_engine() - this includes CREATE TABLE behavior as well as setinputsizes() for bound parameters. On the read side, automatic Unicode conversion under Python 2 has been added to CHAR/VARCHAR/CLOB result rows, to match the behavior of cx_Oracle under Python 3. In order to mitigate the performance hit under Python 2, SQLAlchemy’s very performant (when C extensions are built) native Unicode handlers are used under Python 2.

    References: #4242

misc

Previous: What’s New in SQLAlchemy 1.3? Next: 1.2 Changelog