org.apache.spark.dict

类 NGlobalDictHDFSStore

java.lang.Object

org.apache.spark.dict.NGlobalDictStore

org.apache.spark.dict.NGlobalDictHDFSStore

public class NGlobalDictHDFSStore
extends NGlobalDictStore

构造器概要

构造器

构造器和说明
NGlobalDictHDFSStore(String baseDir)

方法概要

限定符和类型	方法和说明
void	commit(String workingDir, int maxVersions, long versionTTL)
it.unimi.dsi.fastutil.objects.Object2LongMap<String>	getBucketDict(long version, NGlobalDictMetaInfo metaInfo, int bucketId)
NGlobalDictMetaInfo	getMetaInfo(long version)
org.apache.hadoop.fs.Path	getVersionDir(long version)
Long[]	listAllVersions()
void	writeBucketCurrDict(String workingPath, int bucketId, it.unimi.dsi.fastutil.objects.Object2LongMap<String> openHashMap)
void	writeBucketPrevDict(String workingPath, int bucketId, it.unimi.dsi.fastutil.objects.Object2LongMap<String> openHashMap)
void	writeMetaInfo(int bucketSize, String workingPath)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

NGlobalDictHDFSStore

public NGlobalDictHDFSStore(String baseDir)
                     throws IOException

抛出:

IOException

方法详细资料

listAllVersions

public Long[] listAllVersions()
                       throws IOException

指定者:

listAllVersions 在类中 NGlobalDictStore

返回:

all versions of this dictionary in ascending order

抛出:

IOException - on I/O error

getVersionDir

public org.apache.hadoop.fs.Path getVersionDir(long version)

指定者:

getVersionDir 在类中 NGlobalDictStore

getMetaInfo

public NGlobalDictMetaInfo getMetaInfo(long version)
                                throws IOException

指定者:

getMetaInfo 在类中 NGlobalDictStore

抛出:

IOException

getBucketDict

public it.unimi.dsi.fastutil.objects.Object2LongMap<String> getBucketDict(long version,
                                                                          NGlobalDictMetaInfo metaInfo,
                                                                          int bucketId)
                                                                   throws IOException

指定者:

getBucketDict 在类中 NGlobalDictStore

抛出:

IOException

writeBucketCurrDict

public void writeBucketCurrDict(String workingPath,
                                int bucketId,
                                it.unimi.dsi.fastutil.objects.Object2LongMap<String> openHashMap)
                         throws IOException

指定者:

writeBucketCurrDict 在类中 NGlobalDictStore

抛出:

IOException

writeBucketPrevDict

public void writeBucketPrevDict(String workingPath,
                                int bucketId,
                                it.unimi.dsi.fastutil.objects.Object2LongMap<String> openHashMap)
                         throws IOException

指定者:

writeBucketPrevDict 在类中 NGlobalDictStore

抛出:

IOException

writeMetaInfo

public void writeMetaInfo(int bucketSize,
                          String workingPath)
                   throws IOException

指定者:

writeMetaInfo 在类中 NGlobalDictStore

抛出:

IOException

commit

public void commit(String workingDir,
                   int maxVersions,
                   long versionTTL)
            throws IOException

指定者:

commit 在类中 NGlobalDictStore

抛出:

IOException