足球比分直播

智慧城市_集团大数据平台整体方案建议书_v1.0(编辑).doc

返回
智慧城市_集团大数据平台整体方案建议书_v1.0(编辑).doc_第1页
第1页 / 共529页
智慧城市_集团大数据平台整体方案建议书_v1.0(编辑).doc_第2页
第2页 / 共529页
智慧城市_集团大数据平台整体方案建议书_v1.0(编辑).doc_第3页
第3页 / 共529页
智慧城市_集团大数据平台整体方案建议书_v1.0(编辑).doc_第4页
第4页 / 共529页
智慧城市_集团大数据平台整体方案建议书_v1.0(编辑).doc_第5页
第5页 / 共529页
点击查看更多>>
资源描述:
1集团大数据平台整体方案建议书2目 录1 项目概述 ...............................................................................................................................141.1 建设背景 .............................................................................................................................141.1.1 集团已有基础 ................................................................................................................141.1.2 痛点及需提升的能力 ....................................................................................................141.1.3 大数据趋势 ....................................................................................................................151.2 建设目标 .............................................................................................................................151.2.1 总体目标 ........................................................................................................................151.2.2 分阶段建设目标 ............................................................................................................161.3 与相关系统的关系 .............................................................................................................161.3.1 数据分析综合服务平台 ................................................................................................161.3.2 量收系统 ........................................................................................................................171.3.3 金融大数据平台 ............................................................................................................181.3.4 各生产系统 ....................................................................................................................181.3.5 CRM...............................................................................................................................181.4 公司介绍和优势特点 .........................................................................................................181.4.1 IDEADATA....................................................................................................................181.4.2 TRANSWARP...............................................................................................................201.4.3 我们的优势 ....................................................................................................................212 业务需求分析 ........................................................................................................................242.1 总体需求 .............................................................................................................................242.2 数据管理 .............................................................................................................................2532.2.1 数据采集 ........................................................................................................................262.2.2 数据交换 ........................................................................................................................262.2.3 数据存储与管理 ............................................................................................................262.2.4 数据加工清洗 ................................................................................................................272.2.5 数据查询计算 ................................................................................................................272.3 数据管控 .............................................................................................................................282.4 数据分析与挖掘 .................................................................................................................292.5 数据展现 .............................................................................................................................292.6 量收系统功能迁移 .............................................................................................................303 系统架构设计 ........................................................................................................................313.1 总体设计目标 .....................................................................................................................313.2 总体设计原则 .....................................................................................................................313.3 案例分析建议 .....................................................................................................................323.3.1 中国联通大数据平台 ....................................................................................................323.3.2 恒丰银行大数据平台 ....................................................................................................393.3.3 华通 CDN 运营商海量日志采集分析系统 ..................................................................513.3.4 案例总结 ........................................................................................................................563.4 系统总体架构设计 .............................................................................................................573.4.1 总体技术框架 ................................................................................................................573.4.2 系统总体逻辑结构 ........................................................................................................603.4.3 平台组件关系 ................................................................................................................623.4.4 系统接口设计 ................................................................................................................6743.4.5 系统网络结构 ................................................................................................................714 系统功能设计 ........................................................................................................................734.1 概述 .....................................................................................................................................734.2 平台管理功能 .....................................................................................................................734.2.1 多应用管理 ....................................................................................................................734.2.2 多租户管理 ....................................................................................................................774.2.3 统一运维监控 ................................................................................................................784.2.4 作业调度管理 ................................................................................................................974.3 数据管理 .............................................................................................................................994.3.1 数据管理框架 ................................................................................................................994.3.2 数据采集 ......................................................................................................................1014.3.3 数据交换 ......................................................................................................................1044.3.4 数据存储与管理 ..........................................................................................................1054.3.5 数据加工清洗 ..............................................................................................................1234.3.6 数据计算 ......................................................................................................................1244.3.7 数据查询 ......................................................................................................................1394.4 数据管控 ...........................................................................................................................1584.4.1 主数据管理 ..................................................................................................................1584.4.2 元数据管理技术 ..........................................................................................................1604.4.3 数据质量 ......................................................................................................................1634.5 数据 ETL ...........................................................................................................................1704.6 数据分析与挖掘 ...............................................................................................................17254.6.1 数据分析流程 ..............................................................................................................1744.6.2 R 语言开发环境与接口 ...............................................................................................1754.6.3 并行化 R 算法支持 ......................................................................................................1764.6.4 可视化 R 软件包 ..........................................................................................................1794.6.5 编程语言支持 ..............................................................................................................1814.6.6 自然语言处理和文本挖掘 ..........................................................................................1814.6.7 实时分析 ......................................................................................................................1824.6.8 分析管理 ......................................................................................................................1824.6.9 分析支持 ......................................................................................................................1864.6.10 指标维护 .................................................................................................................1864.6.11 分析流程固化 ..........................................................................................................1874.6.12 分析结果发布 ..........................................................................................................1874.6.13 环境支持 .................................................................................................................1874.7 数据展现 ...........................................................................................................................1884.7.1 交互式报表 ..................................................................................................................1904.7.2 仪表盘 ..........................................................................................................................1954.7.3 即席查询 ......................................................................................................................1964.7.4 内存分析 ......................................................................................................................1974.7.5 移动分析 ......................................................................................................................1984.7.6 电子地图支持 ..............................................................................................................1985 技术要求实现 ......................................................................................................................2005.1 产品架构 ...........................................................................................................................20065.1.1 基础构建平台 ..............................................................................................................2035.1.2 大数据平台组件功能介绍 ..........................................................................................2045.1.3 系统分布式架构 ..........................................................................................................2425.2 运行环境支持 ...................................................................................................................2445.2.1 系统操作支持以及环境配置 .......................................................................................2445.2.2 与第三方软件平台的兼容说明 ...................................................................................2455.3 客户端支持 .......................................................................................................................2465.3.1 客户端支持 ..................................................................................................................2465.3.2 移动端支持 ..................................................................................................................2465.4 数据支持 ...........................................................................................................................2465.5 集成实现 ...........................................................................................................................2485.6 运维实现 ...........................................................................................................................2505.6.1 运维目标 ......................................................................................................................2505.6.2 运维服务内容 ..............................................................................................................2515.6.3 运维服务流程 ..............................................................................................................2535.6.4 运维服务制度规范 ......................................................................................................2555.6.5 应急服务响应措施 ......................................................................................................2565.6.6 平台监控兼容 ..............................................................................................................2565.6.7 资源管理 ......................................................................................................................2575.6.8 系统升级 ......................................................................................................................2595.6.9 系统监控平台功能 ......................................................................................................2605.7 平台性能 ...........................................................................................................................26875.7.1 集群切换 ......................................................................................................................2685.7.2 节点切换 ......................................................................................................................2705.7.3 性能调优 ......................................................................................................................2715.7.4 并行化高性能计算 ......................................................................................................2765.7.5 计算性能线性扩展 ......................................................................................................2795.8 平台扩展性 .......................................................................................................................2805.9 可靠性和可用性 ...............................................................................................................2825.9.1 单点故障消除 ..............................................................................................................2825.9.2 容灾备份优化 ...
展开阅读全文
收藏
下载资源

加入会员免费下载





足球比分直播