Be Pythonic

2009-11-19T00:20:46.854681Z

This article is intended for new users of Python.

When going from one language to another, some things have to be unlearned (see Transfer of Learning). What you know from other languages may not be always useful in Python. This page contains some idioms used in Python that I particularly like, and I hope others find useful in their quest for Pythonicity.

You need counters rarely, and iterators only occasionally

Wrong:

i = 0
while i<10:
     do_something(i)
     i += 1

Pythonic:

for i in xrange(10):
    do_something(i)

The following example indexes a list.

Wrong:

i = 0
while i<len(L):
    do_something(L[i])
    i += 1

Pythonic:

for item in L:
    do_something(item)

An iterator variable is useful when you want to maintain looping state between two 'runs':

itrL = iter(L)

for item in itrL:
    do_something(item)
    if is_some_condition(item):
        break

for item in itrL:    # continues where previous loop left off
    do_something_else(item)

You may not need that `for` loop

Python provides many higher level facilities to operate on sequences, such as zip(), max(), min(), list comprehensions, generator expressions and so on. See Built-in Functions for these functions and more.

Keep data in tuples, lists and dictionaries, and operate on entire collections for that fuzzy Pythonic feeling. For example, here is some code that reads a CSV file (with first row being the field names), converts each line into a dictionary record, and calculates the sum on the 'quantity' column:

f = open('filename.csv')                    # f is an iterator
field_names = f.next().split(',')         # get the first item from the iterator using next()
records = [dict(zip(field_names, line.split(',')))  for line in f]  # this will pull remaining lines
print sum(int(record['quantity'])  for record in records)

Though a little naive (you should be using the csv module anyway, which is part of the Python Standard Library), this example demonstrates some useful features. Using zip() with dict() you can combine a tuple of field names with a tuple of values and make a dictionary - combine with list comprehensions you can do this to an entire list in one go.

Tuples are not read-only lists

Tuples usually indicate a heterogenous collection, for example (first_name, last_name) or (ip_address, port). Note that the type may be same (as in first_name and last_name may both be strings), but the real world meaning is usually different. You can think of a tuple as a row in a relational database - in fact the database row is even called a tuple in formal descriptions of the relational model. By contrast, a list of names is always a list, even though a particular function may not change it, that does not make it a tuple.

Tuple unpacking is a useful technique to extract values from a tuple. For example:

for (ip_address, port) in all_connections:
    if port<2000:
        print 'Connected to %s on %s' % (ip_address, port)

Reading this code tells you that all_connections is a list (or iterable) contaning tuples of the form (ip_address, port). This is much clearer than using for item in all_connections and then poking inside item using item[0] or similar techniques.

Unpacking is also useful while returning multiple values from a function:

name, ext = os.path.splitext(filename)    # split a file name into first part and extension

Classes are not for grouping utility functions

C# and Java can have code only within classes, and end up with many utility classes containing only static methods. A common example is a math functions such as sin(). In Python you just use a module with the top level functions.

Say no to getter and setter methods

Yes, encapsulation is important. No, getters and setters are not the only way to implement encapsulation. In Python, you can use a property to replace a member variable and completely change the implementation mechanism, with no change to any calling code.

Functions are objects

A function is a object that happens to be callable. This example sorts a list of dictionaries based on the value of 'price' key in the dictionaries:

#  define a function that returns useful data from within an object
def get_price(ob):
    return ob['price']

L.sort(key=get_price)   # sort a list using the ['price'] value of objects in the list

You can also use sorted(L, key=get_price) to return a new list instead of modifying the list in-place.

Python Types and Objects

2009-11-15T03:17:19.281433Z

Abstract

Explains different Python new-style objects:

what are the <type 'type'> and <type 'object'> types
how user defined classes and instances are related to each other and to built-in types
what are metaclasses

The system described is sometimes called the Python type system, or the object model.

Read The Book

This book is part of a series:

Python Types and Objects [you are here]
Python Attributes and Methods

Comments

Python Attributes and Methods

2009-11-15T03:17:10.946682Z

Abstract

Explains the mechanics of attribute access for new-style Python objects:

how functions become methods
how descriptors and properties work
method resolution order for classes

Read The Book

This book is part of a series:

Python Types and Objects
Python Attributes and Methods [you are here]

Comments

CafePy.com Articles

Be Pythonic

You need counters rarely, and iterators only occasionally

You may not need that `for` loop

Tuples are not read-only lists

Classes are not for grouping utility functions

Say no to getter and setter methods

Functions are objects

Related Links

Python Types and Objects

Abstract

Read The Book

Related

Python Attributes and Methods

Abstract

Read The Book

Related

CafePy.com Articles

Be Pythonic

You need counters rarely, and iterators only occasionally

You may not need that for loop

Tuples are not read-only lists

Classes are not for grouping utility functions

Say no to getter and setter methods

Functions are objects

Related Links

Python Types and Objects

Abstract

Read The Book

Related

Python Attributes and Methods

Abstract

Read The Book

Related

You may not need that `for` loop