The clt thread, "Tcl_ObjSetVar2... ,Martin Lembug ,2005-10-12 ", and Bug #1334947 revived the discussion of how to properly manage the reference count of Tcl_Objs.
This is an attempt at clarifying the issue, and a roadmap to improving both the core's refCount management as well as the documentation related to the subject.
1. Categorization
Joe English writes: There are roughly four classes of Tcl_Obj-related library routines:
and Donal Fellows adds the category
Please note that the same funtion may belong to different categories with respect to different arguments: for example, as currently implemented (up to Tcl8.5a4), the function Tcl_ObjSetVar2(interp, part1Ptr, part2Ptr, newValuePtr, flags) is a Reader wrt part1Ptr and part2Ptr, but a Hairy-Monster wrt newValuePtr. (DKF: It should be noted that there is no guarantee that Tcl_ObjSetVar2 will remain a reader wrt part2ptr; if we ever optimize internal memory management of arrays, that will likely change. This is why knowing which function is what with respect to each argument is hard.)
As a general rule, all Tcl commands should be considered to be Hairy-Monsters wrt the objects in the objv array.
We hope to improve the documentation wrt to the categorization of the different functions, and also to reduce significantly the population of Hairy-Monsters. As of today, Constructors and Mutators should be properly documented as such.
2. Rules for dealing safely with the different categories
Note first that Constructors are not an issue: there is no Tcl_Obj to manage before you call them.
The always-safe rules are:
The optimal rules in terms of performance and code simplicity (but risky in light of incomplete documentation) are:
I have been trying to understand clearly the rules for Tcl reference counting of objects, and how to properly use the increment and decrement ref count operations. I finally came across a question and answer posting elsewhere, in which Donal K. Fellows clearly explains a very, very, VERY important concept:
Tcl Does Not Garbage Collect!
What does this mean for the Tcl extension writer? I can sum it up in a nutshell... if you create an object, and you never pass it back to Tcl as part of another object (eg a list object), or as the result object, it will NOT get freed. You MUST call Tcl_DecrRefCount() because this is where the memory deallocator gets called... and nowhere else!
It goes without saying that for a very experienced programmer such as myself to have to hunt around for this morsel of information means that the documentation for Tcl Objects in the Tcl C reference is not explicit enough in making this fact crystal clear.
It should also be pointed out that calling Tcl_DecrRefCount() to free an allocated object, without first having called Tcl_IncrRefCount(), is perfectly OK. The deallocation will happen if the ref count is zero or negative. This can be the case if you must create a new object for the sole purpose of passing it as an argument to another Tcl API, but then have no further use for it. If that bit of code is called over and over, you will end up with many cats and hats wandering in the woods outside Mr. Tesla's mountain laboratory, homeless.
I hope someone finds this clarification useful.