Class to handle job queues stored in the DB. More...

Inheritance diagram for JobQueueDB:

Collaboration diagram for JobQueueDB:

Public Member Functions
	doBatchPushInternal (IDatabase $dbw, array $jobs, $flags, $method)
	This function should not be called outside of JobQueueDB. More...

	getAllAcquiredJobs ()

	getAllQueuedJobs ()

	getCoalesceLocationInternal ()

	recycleAndDeleteStaleJobs ()
	Recycle or destroy any jobs that have been claimed for too long. More...

Public Member Functions inherited from JobQueue
	ack (Job $job)
	Acknowledge that a job was completed. More...

	batchPush (array $jobs, $flags=0)
	Push a batch of jobs into the queue. More...

	deduplicateRootJob (IJobSpecification $job)
	Register the "root job" of a given job into the queue for de-duplication. More...

	delayedJobsEnabled ()

	delete ()
	Deleted all unclaimed and delayed jobs from the queue. More...

	flushCaches ()
	Clear any process and persistent caches. More...

	getAbandonedCount ()
	Get the number of acquired jobs that can no longer be attempted. More...

	getAcquiredCount ()
	Get the number of acquired jobs (these are temporarily out of the queue). More...

	getAllAbandonedJobs ()
	Get an iterator to traverse over all abandoned jobs in this queue. More...

	getAllAcquiredJobs ()
	Get an iterator to traverse over all claimed jobs in this queue. More...

	getAllDelayedJobs ()
	Get an iterator to traverse over all delayed jobs in this queue. More...

	getAllQueuedJobs ()
	Get an iterator to traverse over all available jobs in this queue. More...

	getCoalesceLocationInternal ()
	Do not use this function outside of JobQueue/JobQueueGroup. More...

	getDelayedCount ()
	Get the number of delayed jobs (these are temporarily out of the queue). More...

	getOrder ()

	getReadOnlyReason ()

	getSiblingQueueSizes (array $types)
	Check the size of each of the given queues. More...

	getSiblingQueuesWithJobs (array $types)
	Check whether each of the given queues are empty. More...

	getSize ()
	Get the number of available (unacquired, non-delayed) jobs in the queue. More...

	getType ()

	getWiki ()

	isEmpty ()
	Quickly check if the queue has no available (unacquired, non-delayed) jobs. More...

	pop ()
	Pop a job off of the queue. More...

	push ($jobs, $flags=0)
	Push one or more jobs into the queue. More...

	waitForBackups ()
	Wait for any slaves or backup servers to catch up. More...

Static Public Member Functions
static	selectFields ()
	Return the list of job fields that should be selected. More...

Static Public Member Functions inherited from JobQueue
static	factory (array $params)
	Get a job queue object of the specified type. More...

static	incrStats ($key, $type, $delta=1)
	Call wfIncrStats() for the queue overall and for the queue type. More...

Public Attributes
const	CACHE_TTL_SHORT = 30

const	MAX_AGE_PRUNE = 604800

const	MAX_JOB_RANDOM = 2147483647

const	MAX_OFFSET = 255

Public Attributes inherited from JobQueue
const	QOS_ATOMIC = 1

const	ROOTJOB_TTL = 2419200

Protected Member Functions
	__construct (array $params)
	Additional parameters include: More...

	claimOldest ($uuid)
	Reserve a row with a single UPDATE without holding row locks over RTTs... More...

	claimRandom ($uuid, $rand, $gte)
	Reserve a row with a single UPDATE without holding row locks over RTTs... More...

	doAck (Job $job)

	doBatchPush (array $jobs, $flags)

	doDeduplicateRootJob (IJobSpecification $job)

	doDelete ()

	doFlushCaches ()

	doGetAbandonedCount ()

	doGetAcquiredCount ()

	doGetSiblingQueueSizes (array $types)

	doGetSiblingQueuesWithJobs (array $types)

	doGetSize ()

	doIsEmpty ()

	doPop ()

	doWaitForBackups ()

	getDB ($index)

	getJobIterator (array $conds)

	getMasterDB ()

	getSlaveDB ()

	insertFields (IJobSpecification $job)

	optimalOrder ()

	supportedOrders ()

	throwDBException (DBError $e)

Protected Member Functions inherited from JobQueue
	__construct (array $params)

	assertNotReadOnly ()

	doAck (Job $job)

	doBatchPush (array $jobs, $flags)

	doDeduplicateRootJob (IJobSpecification $job)

	doDelete ()

	doFlushCaches ()

	doGetAbandonedCount ()

	doGetAcquiredCount ()

	doGetDelayedCount ()

	doGetSiblingQueueSizes (array $types)

	doGetSiblingQueuesWithJobs (array $types)

	doGetSize ()

	doIsEmpty ()

	doIsRootJobOldDuplicate (Job $job)

	doPop ()

	doWaitForBackups ()

	getRootJobCacheKey ($signature)

	isRootJobOldDuplicate (Job $job)
	Check if the "root" job of a given job has been superseded by a newer one. More...

	optimalOrder ()
	Get the default queue order to use if configuration does not specify one. More...

	supportedOrders ()
	Get the allowed queue orders for configuration validation. More...

	supportsDelayedJobs ()
	Find out if delayed jobs are supported for configuration validation. More...

Static Protected Member Functions
static	extractBlob ($blob)

static	makeBlob ($params)

Protected Attributes
WANObjectCache	$cache

bool string	$cluster = false
	Name of an external DB cluster. More...

Protected Attributes inherited from JobQueue
JobQueueAggregator	$aggr

int	$claimTTL
	Time to live in seconds. More...

BagOStuff	$dupCache

int	$maxTries
	Maximum number of times to try a job. More...

string	$order
	Job priority for pop() More...

string bool	$readOnlyReason
	Read only rationale (or false if r/w) More...

string	$type
	Job type. More...

string	$wiki
	Wiki ID. More...

Private Member Functions
	getCacheKey ($property)

Detailed Description

Class to handle job queues stored in the DB.

Since: 1.21

Definition at line 30 of file JobQueueDB.php.

Constructor & Destructor Documentation

JobQueueDB::__construct ( array $params )

protected

Additional parameters include:

cluster : The name of an external cluster registered via LBFactory. If not specified, the primary DB cluster for the wiki will be used. This can be overridden with a custom cluster so that DB handles will be retrieved via LBFactory::getExternalLB() and getConnection().
Parameters

array $params

Definition at line 50 of file JobQueueDB.php.

References cache, and ObjectCache\getMainWANInstance().

Member Function Documentation

JobQueueDB::claimOldest ( $uuid )

protected

Reserve a row with a single UPDATE without holding row locks over RTTs...

Parameters

string $uuid 32 char hex string

Returns: stdClass|bool Row|false

Definition at line 396 of file JobQueueDB.php.

References getMasterDB(), type, and wfDebug().

Referenced by doPop().

JobQueueDB::claimRandom	(	$uuid,
		$rand,
		$gte
	)

protected

Reserve a row with a single UPDATE without holding row locks over RTTs...

Parameters

string	$uuid	32 char hex string
int	$rand	Random unsigned integer (31 bits)
bool	$gte	Search for job_random >= $random (otherwise job_random <= $random)

Returns: stdClass|bool Row|false

Definition at line 319 of file JobQueueDB.php.

References $dir, JobQueue\$type, cache, getCacheKey(), getMasterDB(), and type.

Referenced by doPop().

JobQueueDB::doAck ( Job $job )

protected

See Also: JobQueue::doAck()

Parameters

Job $job

Exceptions

MWException

Definition at line 456 of file JobQueueDB.php.

References $e, DBO_TRX, getMasterDB(), JobQueue\incrStats(), throwDBException(), type, and use.

JobQueueDB::doBatchPush	(	array	$jobs,
			$flags
	)

protected

See Also: JobQueue::doBatchPush()

Parameters

	IJobSpecification[]	$jobs
int	$flags

Exceptions

DBError|Exception

Returns: void

Definition at line 181 of file JobQueueDB.php.

References $flags, doBatchPushInternal(), getMasterDB(), and use.

JobQueueDB::doBatchPushInternal	(	IDatabase	$dbw,
		array	$jobs,
			$flags,
			$method
	)

This function should not be called outside of JobQueueDB.

Parameters

IDatabase	$dbw
	IJobSpecification[]	$jobs
int	$flags
string	$method

Exceptions

DBError

Returns: void

Definition at line 202 of file JobQueueDB.php.

References $e, $flags, $job, $res, as, IDatabase\endAtomic(), JobQueue\incrStats(), IDatabase\insert(), insertFields(), IDatabase\rollback(), IDatabase\select(), IDatabase\startAtomic(), type, and wfDebug().

Referenced by doBatchPush().

JobQueueDB::doDeduplicateRootJob ( IJobSpecification $job )

protected

See Also: JobQueue::doDeduplicateRootJob()

Parameters

IJobSpecification $job

Exceptions

MWException

Returns: bool

Definition at line 486 of file JobQueueDB.php.

References $cache, JobQueue\$dupCache, $params, $timestamp, WANObjectCache\get(), getMasterDB(), IJobSpecification\getParams(), JobQueue\getRootJobCacheKey(), JobQueue\ROOTJOB_TTL, WANObjectCache\set(), and use.

JobQueueDB::doDelete ( )

protected

See Also: JobQueue::doDelete()

Returns: bool

Definition at line 518 of file JobQueueDB.php.

References $e, getMasterDB(), throwDBException(), and type.

JobQueueDB::doFlushCaches ( )

protected

Returns: void

Definition at line 540 of file JobQueueDB.php.

References JobQueue\$type, as, cache, and getCacheKey().

JobQueueDB::doGetAbandonedCount ( )

protected

See Also: JobQueue::doGetAbandonedCount()

Returns: int

Exceptions

MWException

Definition at line 143 of file JobQueueDB.php.

References $count, $dbr, $e, cache, getCacheKey(), getSlaveDB(), and throwDBException().

JobQueueDB::doGetAcquiredCount ( )

protected

See Also: JobQueue::doGetAcquiredCount()

Returns: int

Definition at line 112 of file JobQueueDB.php.

References $count, $dbr, $e, cache, getCacheKey(), getSlaveDB(), and throwDBException().

JobQueueDB::doGetSiblingQueueSizes ( array $types )

protected

Definition at line 611 of file JobQueueDB.php.

References $dbr, $res, as, and getSlaveDB().

JobQueueDB::doGetSiblingQueuesWithJobs ( array $types )

protected

Definition at line 594 of file JobQueueDB.php.

References $dbr, $res, as, and getSlaveDB().

JobQueueDB::doGetSize ( )

protected

See Also: JobQueue::doGetSize()

Returns: int

Definition at line 86 of file JobQueueDB.php.

References $dbr, $e, cache, getCacheKey(), getSlaveDB(), and throwDBException().

JobQueueDB::doIsEmpty ( )

protected

See Also: JobQueue::doIsEmpty()

Returns: bool

Definition at line 69 of file JobQueueDB.php.

References $dbr, $e, getSlaveDB(), throwDBException(), and type.

JobQueueDB::doPop ( )

protected

See Also: JobQueue::doPop()

Returns: Job|bool

Definition at line 264 of file JobQueueDB.php.

References $e, $job, $title, claimOldest(), claimRandom(), DBO_TRX, Job\factory(), getMasterDB(), JobQueue\incrStats(), Title\makeTitle(), order, recycleAndDeleteStaleJobs(), throwDBException(), type, use, and wfRandomString().

JobQueueDB::doWaitForBackups ( )

protected

See Also: JobQueue::doWaitForBackups()

Returns: void

Definition at line 533 of file JobQueueDB.php.

References wfWaitForSlaves(), and wiki.

static JobQueueDB::extractBlob ( $blob )

staticprotected

Parameters

string $blob

Returns: bool|mixed

Definition at line 797 of file JobQueueDB.php.

References $blob, and unserialize().

JobQueueDB::getAllAcquiredJobs ( )

See Also: JobQueue::getAllAcquiredJobs()

Returns: Iterator

Definition at line 558 of file JobQueueDB.php.

References getJobIterator(), and JobQueue\getType().

JobQueueDB::getAllQueuedJobs ( )

See Also: JobQueue::getAllQueuedJobs()

Returns: Iterator

Definition at line 550 of file JobQueueDB.php.

References getJobIterator(), and JobQueue\getType().

JobQueueDB::getCacheKey ( $property )

private

Parameters

string $property

Returns: string

Definition at line 774 of file JobQueueDB.php.

References $cluster, $property, list, type, wfForeignMemcKey(), wfSplitWikiID(), and wiki.

Referenced by claimRandom(), doFlushCaches(), doGetAbandonedCount(), doGetAcquiredCount(), and doGetSize().

JobQueueDB::getCoalesceLocationInternal ( )

Definition at line 588 of file JobQueueDB.php.

JobQueueDB::getDB ( $index )

protected

Parameters

int $index (DB_SLAVE/DB_MASTER)

Returns: DBConnRef

Definition at line 762 of file JobQueueDB.php.

References false, wfGetLB(), wfGetLBFactory(), and wiki.

Referenced by getMasterDB(), and getSlaveDB().

JobQueueDB::getJobIterator ( array $conds )

protected

Parameters

array $conds Query conditions

Returns: Iterator

Definition at line 566 of file JobQueueDB.php.

References $dbr, $e, $job, Job\factory(), getSlaveDB(), Title\makeTitle(), throwDBException(), and unserialize().

Referenced by getAllAcquiredJobs(), and getAllQueuedJobs().

JobQueueDB::getMasterDB ( )

protected

Exceptions

JobQueueConnectionError

Returns: DBConnRef

Definition at line 750 of file JobQueueDB.php.

References $e, DB_MASTER, and getDB().

Referenced by claimOldest(), claimRandom(), doAck(), doBatchPush(), doDeduplicateRootJob(), doDelete(), doPop(), insertFields(), and recycleAndDeleteStaleJobs().

JobQueueDB::getSlaveDB ( )

protected

Exceptions

JobQueueConnectionError

Returns: DBConnRef

Definition at line 738 of file JobQueueDB.php.

References $e, DB_SLAVE, and getDB().

Referenced by doGetAbandonedCount(), doGetAcquiredCount(), doGetSiblingQueueSizes(), doGetSiblingQueuesWithJobs(), doGetSize(), doIsEmpty(), and getJobIterator().

JobQueueDB::insertFields ( IJobSpecification $job )

protected

Parameters

IJobSpecification $job

Returns: array

Definition at line 714 of file JobQueueDB.php.

References IJobSpecification\getDeduplicationInfo(), getMasterDB(), IJobSpecification\getParams(), IJobSpecification\getTitle(), IJobSpecification\getType(), and serialize().

Referenced by doBatchPushInternal().

static JobQueueDB::makeBlob ( $params )

staticprotected

Parameters

array | bool $params

Returns: string

Definition at line 785 of file JobQueueDB.php.

References $params, and serialize().

JobQueueDB::optimalOrder ( )

protected

Definition at line 61 of file JobQueueDB.php.

JobQueueDB::recycleAndDeleteStaleJobs ( )

Recycle or destroy any jobs that have been claimed for too long.

Returns: int Number of jobs recycled/deleted

Definition at line 629 of file JobQueueDB.php.

References $count, $e, $res, JobQueue\$type, getMasterDB(), JobQueue\incrStats(), throwDBException(), type, and wiki.

Referenced by doPop().

static JobQueueDB::selectFields ( )

static

Return the list of job fields that should be selected.

Since: 1.23

Returns: array

Definition at line 818 of file JobQueueDB.php.

JobQueueDB::supportedOrders ( )

protected

Definition at line 57 of file JobQueueDB.php.

JobQueueDB::throwDBException ( DBError $e )

protected

Parameters

DBError $e

Exceptions

JobQueueError

Definition at line 809 of file JobQueueDB.php.

Referenced by doAck(), doDelete(), doGetAbandonedCount(), doGetAcquiredCount(), doGetSize(), doIsEmpty(), doPop(), getJobIterator(), and recycleAndDeleteStaleJobs().

Member Data Documentation

WANObjectCache JobQueueDB::$cache

protected

Definition at line 37 of file JobQueueDB.php.

Referenced by doDeduplicateRootJob().

bool string JobQueueDB::$cluster = false

protected

Name of an external DB cluster.

False if not set

Definition at line 40 of file JobQueueDB.php.

Referenced by getCacheKey().

const JobQueueDB::CACHE_TTL_SHORT = 30

Definition at line 31 of file JobQueueDB.php.

const JobQueueDB::MAX_AGE_PRUNE = 604800

Definition at line 32 of file JobQueueDB.php.

const JobQueueDB::MAX_JOB_RANDOM = 2147483647

Definition at line 33 of file JobQueueDB.php.

const JobQueueDB::MAX_OFFSET = 255

Definition at line 34 of file JobQueueDB.php.

The documentation for this class was generated from the following file:

includes/jobqueue/JobQueueDB.php

Public Member Functions

Static Public Member Functions

Public Attributes

Protected Member Functions

Static Protected Member Functions

Protected Attributes

Private Member Functions

Detailed Description

Constructor & Destructor Documentation

Member Function Documentation

Member Data Documentation