2017-03-02 86 views
1

將大量數據添加到我的aerospike數據庫後,大量數據消失。 我也嘗試禁用TTL和驅逐。但沒有任何工作。 當前我正在使用默認配置。Aerospike數據消失

namespace test { 
    replication-factor 2 
    memory-size 4G 
    default-ttl 30d # 30 days, use 0 to never expire/evict. 
    storage-engine memory 
} 

有保存對象256.408(24%的內存使用情況),一些分鐘後 只有133.294對象(13%的內存使用情況)。 13,229個對象已過期(看起來是正確的) 0被驅逐的對象

發生了什麼與我的數據?

Admin> asinfo 

1 : node 
    BB9E091CB7AC40C 
2 : statistics 
    cluster_size=1;cluster_key=DCF17F353E9E73A7;cluster_integrity=true;uptime=545;system_free_mem_pct=79;system_swapping=false;heap_allocated_kbytes=1654377;heap_active_kbytes=1863852;heap_mapped_kbytes=2336768;heap_efficiency_pct=71;objects=133295;sub_objects=0;tombstones=0;tsvc_queue=0;info_queue=0;delete_queue=0;rw_in_progress=0;proxy_in_progress=0;tree_gc_queue=0;client_connections=31;heartbeat_connections=0;fabric_connections=0;heartbeat_received_self=3635;heartbeat_received_foreign=0;reaped_fds=0;info_complete=9935;proxy_retry=0;demarshal_error=0;early_tsvc_client_error=0;early_tsvc_batch_sub_error=0;early_tsvc_udf_sub_error=0;batch_index_initiate=0;batch_index_queue=0:0,0:0,0:0,0:0;batch_index_complete=0;batch_index_error=0;batch_index_timeout=0;batch_index_unused_buffers=0;batch_index_huge_buffers=0;batch_index_created_buffers=0;batch_index_destroyed_buffers=0;batch_initiate=0;batch_queue=0;batch_error=0;batch_timeout=0;scans_active=0;query_short_running=0;query_long_running=0;sindex_ucgarbage_found=0;sindex_gc_locktimedout=0;sindex_gc_inactivity_dur=0;sindex_gc_activity_dur=0;sindex_gc_list_creation_time=0;sindex_gc_list_deletion_time=0;sindex_gc_objects_validated=0;sindex_gc_garbage_found=0;sindex_gc_garbage_cleaned=0;paxos_principal=BB9E091CB7AC40C;migrate_allowed=true;migrate_partitions_remaining=0;fabric_bulk_send_rate=0;fabric_bulk_recv_rate=0;fabric_ctrl_send_rate=0;fabric_ctrl_recv_rate=0;fabric_meta_send_rate=0;fabric_meta_recv_rate=0;fabric_rw_send_rate=0;fabric_rw_recv_rate=0 
3 : features 
    peers;cdt-list;cdt-map;pipelining;geo;float;batch-index;replicas-all;replicas-master;replicas-prole;udf 
4 : cluster-generation 
    0 
5 : partition-generation 
    1 
6 : build_time 
    Wed Feb 15 21:57:43 UTC 2017 
7 : edition 
    Aerospike Community Edition 
8 : version 
    Aerospike Community Edition build 3.11.1.1 
9 : build 
    3.11.1.1 
10 : services 

11 : services-alumni 

12 : build_os 
    debian8 

Admin> info namespace 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Namespace Information~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
Namespace    Node Avail% Evictions     Master    Replica  Repl  Stop  Pending  Disk Disk  HWM   Mem  Mem HWM  Stop 
     .     .  .   . (Objects,Tombstones) (Objects,Tombstones) Factor Writes Migrates  Used Used% Disk%   Used Used% Mem% Writes% 
     .     .  .   .      .      .  .  . (tx%,rx%)   .  .  .   .  .  .   . 
test  development1:3000 N/E  0.000  (256.408 K,0.000 ) (0.000 ,0.000 )  1  false (0,0)   N/E N/E  50  971.808 MB 24  60  90 
test          0.000  (256.408 K,0.000 ) (0.000 ,0.000 )      (0,0)  0.000 B     971.808 MB 
Number of rows: 2 

Admin> info namespace 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~Namespace Information~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
Namespace    Node Avail% Evictions     Master    Replica  Repl  Stop  Pending  Disk Disk  HWM   Mem  Mem HWM  Stop 
     .     .  .   . (Objects,Tombstones) (Objects,Tombstones) Factor Writes Migrates  Used Used% Disk%   Used Used% Mem% Writes% 
     .     .  .   .      .      .  .  . (tx%,rx%)   .  .  .   .  .  .   . 
test  development1:3000 N/E  0.000  (133.294 K,0.000 ) (0.000 ,0.000 )  1  false (0,0)   N/E N/E  50  506.382 MB 13  60  90 
test          0.000  (133.294 K,0.000 ) (0.000 ,0.000 )      (0,0)  0.000 B     506.382 MB 
Number of rows: 2 
+1

你能給出完整的命名空間統計信息。命令:asinfo -v「命名空間/測試」 – sunil

+1

@DerCoder也發佈了這個:https://discuss.aerospike.com/t/aerospike-data-expire/3329/6,說解決了,問題是與他的代碼,Aerospike工作正常。 – pgupta

+0

@DerCoder,介意分享什麼最終成爲問題? https://m.xkcd.com/979/ – kporter

回答

1

1 - 您如何插入對象?當你插入對象時,你是否修改了默認的TTL?對於30d的默認ttl,你不應該過期對象,(假設你在256K對象下降到133K之間相當快地運行了info命令)。你的物體的大小是多少?

2 - 你能$grep thr_nsup /var/log/aerospike/aerospike.log和後輸出?

3 - 你可以發佈$asinfo -v "namespace/test"

1

THX的輸出對您有所幫助。我在我的代碼中發現了這個問題。 Aerospike工作正常。 對不起,這個「錯誤」的提醒:D