org.apache.spark.dict

类 NGlobalDictStore

java.lang.Object

org.apache.spark.dict.NGlobalDictStore

直接已知子类:

NGlobalDictHDFSStore

public abstract class NGlobalDictStore
extends Object

构造器概要

构造器

构造器和说明
NGlobalDictStore()

方法概要

限定符和类型	方法和说明
abstract void	commit(String workingDir, int maxVersions, long versionTTL)
abstract it.unimi.dsi.fastutil.objects.Object2LongMap<String>	getBucketDict(long version, NGlobalDictMetaInfo metadata, int bucketId)
abstract NGlobalDictMetaInfo	getMetaInfo(long version)
abstract org.apache.hadoop.fs.Path	getVersionDir(long version)
abstract Long[]	listAllVersions()
abstract void	writeBucketCurrDict(String workingPath, int bucketId, it.unimi.dsi.fastutil.objects.Object2LongMap<String> openHashMap)
abstract void	writeBucketPrevDict(String workingPath, int bucketId, it.unimi.dsi.fastutil.objects.Object2LongMap<String> openHashMap)
abstract void	writeMetaInfo(int bucketSize, String workingDir)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

NGlobalDictStore

public NGlobalDictStore()

方法详细资料

listAllVersions

public abstract Long[] listAllVersions()
                                throws IOException

返回:

all versions of this dictionary in ascending order

抛出:

IOException - on I/O error

getVersionDir

public abstract org.apache.hadoop.fs.Path getVersionDir(long version)

getMetaInfo

public abstract NGlobalDictMetaInfo getMetaInfo(long version)
                                         throws IOException

抛出:

IOException

getBucketDict

public abstract it.unimi.dsi.fastutil.objects.Object2LongMap<String> getBucketDict(long version,
                                                                                   NGlobalDictMetaInfo metadata,
                                                                                   int bucketId)
                                                                            throws IOException

抛出:

IOException

writeBucketCurrDict

public abstract void writeBucketCurrDict(String workingPath,
                                         int bucketId,
                                         it.unimi.dsi.fastutil.objects.Object2LongMap<String> openHashMap)
                                  throws IOException

抛出:

IOException

writeBucketPrevDict

public abstract void writeBucketPrevDict(String workingPath,
                                         int bucketId,
                                         it.unimi.dsi.fastutil.objects.Object2LongMap<String> openHashMap)
                                  throws IOException

抛出:

IOException

writeMetaInfo

public abstract void writeMetaInfo(int bucketSize,
                                   String workingDir)
                            throws IOException

抛出:

IOException

commit

public abstract void commit(String workingDir,
                            int maxVersions,
                            long versionTTL)
                     throws IOException

抛出:

IOException